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ABSTRACT 


The  cost  of  training  Air  Traffic  Control  (ATC)  personnel  has  risen  rapidly. 
Attrition  of  students  prior  to  completion  of  the  training  resutls  in  loss  of  invested 
funds  as  well  as  a  delay  in  providing  a  fully  qualified  ATC  specialist  to  the  field, 
for  both  military  and  civilian  agencies .  Improved  selection  and  prediction  tests 
for  ATC  personnel  have  been  recognized  as  essential  to  decrease  attrition  rates. 

This  study  examined  the  selection  utility  of  the  Federal  Aviation  Administration 
(FAA)  prototype  ATC  test  battery  .  The  test  protocol  consisted  of  the  Multiplex  Con¬ 
troller  Aptitude  Test  (MCAT)  ,  a  job  simulation  test;  and  the  Occupational  Knowledge 
Test  (OKT) ,  a  job  knowledge  specific  test.  Two-thousand  four-hundred  ninety -nine 
FAA/ATC  Academy  trainees  from  the  1978  through  1980  period  had  taken  two  versions 
of  the  Multiplex  Controller  Aptitude  Test  (MCAT1  and  MCAT2)  and  one  version  of 
the  Occupational  Knowledge  Test  (OKT)  .  Test  scores  for  1,954  of  these  subjects 
were  merged  with  information  concerning  their  sex  ,  education,  ATC  experience , 

ATC  option,  and  ■;  ass/fail  status  at  the  ATC  Academy.  J) 


Regression  analysis  indicated  that  the  predictive  validity  for  successful  com¬ 
pletion  of  the  FAA  ATC  curriculum  of  the  MCAT1,  MCAT2,  and  OKT,  was  significant 
at  the  p  <  .001;  however,  the  R2  was  low  (R2  =  0.12)  .  Consideration  of  causes 
for  the  low  R2  includes  nonuniform  distribution  of  subjects  and  possible  preselection 
as  the  population  sampled  had  previously  passed  FAA/ATC  entry  criteria . 


"\tem  analyses  indicated  the  MCAT  contained  very  difficult  or  very  easy  items 
in  over  50  percent  of  the  test  questions .  The  OKT  had  acceptable  levels  of  item 
difficulty  at  the  25  percent  level, 


Analyses  of  variance  of  the  versions  of  each  selection  test  (MCAT1,  MCAT2 
and  OKT)  indicated  significant  differences  among  the  versions.  The  nonuniform- 
distribution  of  subjectc  and  a  learning  effect  between  the  test  versions  were  con¬ 
sidered  as  contributing  to  these  differences .  Subject  sampling  and  design  counter¬ 
balancing  problems  ;-,ere  discussed  as  possible  contributing  factors  so  the  low  over¬ 
all  R2 . 


Recommendations  are  presented  for  further  revision  and  analysis  to  improve 
question  utility  and  to  develop  a  sequential  test  evaluation  of  the  ATC  applicant's 
learning  abilities . 
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INTRODUCTION 


Effective  selection  of  Air  Traffic  Control  personnel  has  been  a  continuing  problem 
for  both  military  and  civilian  agencies .  In  the  1980s ,  with  the  rising  cost  of  training 
and  with  the  sudden  great  shortage  of  civilian  Air  Traffic  Controllers  (ATC) ,  the 
federal  government  cannot  afford  to  select  an  individual  'ho  does  not  have  the 
necessary  cognitive  capabilities  to  complete  ATC  School.  The  current  Federal 
Aviation  Administration  (FAA)  Office  of  Personnel  Management  selection  battery  for 
ATC  personnel  has  been  operational  since  1964  (1) .  The  FAA  has  experienced  a  range 
of  attrition  rates  from  as  low  aa  20  percent  to  as  high  as  40  percent  of  ATC  per¬ 
sonnel  during  the  two-to-four  year  training  period  required  to  reach  the  Full  Perfor¬ 
mance  Level  (FPL)  controller  (2) .  A  projected  attrition  rate  of  20  percent  from  the 
time  of  entry  on  duty  until  reaching  FPL  of  an  estimated  1800  new  controllers 
(average  personnel  annual  ixitake)  would  result  in  an  FAA  loss  of  14  million  dollars 
invested  in  salaries ,  training ,  and  equipment  (3) . 

The  Biomedical  and  Behavioral  Sciences  Division,  Office  of  Aviation  Medicine ; 
Federal  Aviation  Administration,  is  currently  involved  in  a  developmental  program 
to  formulate  and  to  implement  job  relevant  selection  instruments  for  ATC  personnel. 

At  presen* .  all  applicants  who  wish  to  become  ATC  personnel  must  pass  both  the 
Civil  Service  Commission  (CSC)  ATC  Aptitude  Test  and  a  physical  examination  in 
order  to  be  eligible  for  employment .  Improvement  in  selection  testing  is  needed  for 
early  identification  of  trainees  that  do  not  possess  the  aptitude  and  the  ability  to 
progress  to  FPL.  A  major  reduction  in  FAA's  investment  loss  from  developmental 
controller  attrition  could  be  realized  through  an  improved  test  battery  (4) . 

The  U.S .  Military  Services  conduct  ATC  training  with  similar  attrition  problems . 
Persons  desiring  to  be  U.S .  Navy  ATC  personnel  must  pass  portions  of  the  Armed 
Services  Vocational  Aptitude  Battery  (ASVAB) .  A  composite  score  of  the  ASVAB’s 
Arithmetic,  Mathematics  Knowledge,  and  the  General  Sciences  subtests  is  currently 
used  as  the  criteria  for  acceptance  into  the  Navy  ATC  piogram.  These  tests  are 
the  result  of  almost  40  years  of  selection  i-esearch  and  development;  however ,  there 
is  still  a  30  percent  attrition  rate  at  the  Navy  ATC  School.  Of  the  students  that  com¬ 
plete  the  Navy  training  program,  approximately  40  percent  require  additional  class¬ 
room  instruction  to  successfully  complete  the  tower  laboratory  phase  of  the  curriculum 
(5) .  This  unacceptable  attrition  rate,  along  with  increased  air  traffic  workload  and 
new  technological  advances ,  emphasizes  the  need  for  improved  selection  tests . 

FAA  efforts  over  the  past  six  years  hsve  resulted  in  the  development  of  the 
Multiplex  Controller  Aptitude  Test  (MCAT)  and  the  Air  Traffic  Controller  Occupational 
Knowledge  Test  (OKT)  as  ATC  selection  tools.  The  MCAT  is  a  customized  test  that 
emphasizes  job  simulation  and  relevance.  It  is  a  timed  paper-and-pencil  test  in  which 
40  percent  of  the  items  attempt  to  measure  the  student’s  ability  to  predict  violations 
of  air  traffic  separation  standards,  conflicts  and  mid-air  collisions.  The  student's 
ability  1b  tested  by  a  simulated  radarscope  and  flight  Information  table  (Figure  1) . 

The  remaining  60  percent  of  the  items  assess  aptitvde  skills  in  table  reading ,  spatial 
visualisation,  and  arithmetic  reasoning  (6) . 
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The  OKT  was  developed  by  the  Office  of  Aviation  Medicine/FAA  with  the  help 
of  several  journeymen  controllers.  These  journeymen  are  at  FPL  with  the  FAA  cur¬ 
rently  performing  the  full  range  of  ATC  operational  duties .  The  OKT  is  a  job- 
knowledge  specific  test  that  measures  the  applicant's  knowledge  of  ATC  work  retained 
from  prior  experience .  The  OKT  samples  knowledge  concerning  Air  Traffic 
Control  regulations ,  terminal  and  enroute  air  traffic  control ,  communications ,  flight 
service  station  work,  navigation  aids,  weather,  and  radar  (7)  . 

In  an  agreement  with  the  FAA,  the  Naval  Aerospace  Medical  Research  Laboratory 
(NAMRL)  conducted  research  analysis  of  the  MCAT  and  OKT  test  batteries  to  determine 
their  predictive  ability  in  the  civilian  community  and  to  recommend  selection  research 
procedures  for  Navy  ATC  candidate  populations . 

METHOD 


SUBJFCTS 

Subjects  were  drawn  from  ATC  candidates  from  the  1978  through  1980  FAA 
Academy  population  who  were  administered  the  MCAT  and  the  OKT ,  All  subjects 
had  volunteered  their  test  scores  to  be  used  for  ATC  personnel  selection  studies . 

Only  those  subjects  who  had  taken  two  versions  of  the  MCAT  and  at  least  one  version 
of  the  OKT  were  utilized  in  this  study.  The  reason  for  exclusion  of  614  subjects  are 
listed  in  Table  1,  A  total  of  2,499  subject  MCAT  and  OKT  answer  sheets  were 
analyzed.  There  were  a  total  of  1609  males  (82.3%)  and  345  females  (17.7%) .  Cau¬ 
casians  comprised  89.4  peraent  (N  =  1747)  of  the  total  sample,  and  Blacks  comprised 
7  percent  (N  =  136)  of  the  subjects.  Thirty-eight  (27.9%)  of  the  Black  applicants, 

300  (17.2%)  of  the  Caucasian  applicants,  and  seven  (9.9%)  of  the  "other"  minorities 
were  female  (Table  2) . 

PROCEDURES 

Each  subject  was  presented  with  two  of  the  l?n  test  versions  of  the  MCAT .  Each 
MCAT  test  contained  55  multiple  choice  items.  The  tests  were  each  divided  into  two 
sections  with  approximately  equal  questions.  In  the  first  section,  subjects  were 
given  eight  minutes  to  study  the  directions  and  to  memorize  the  characteristics  of  the 
aircraft  presented  on  the  simulated  air  traffic  radar  screen  (Figure  1) .  They  were 
allowed  20  minutes  to  answer  the  questions.  Before  the  start  of  the  second  section, 
subjects  were  given  one  minute  to  study  the  next  radar  *  ?enario  followed  by  fifteen 
minutes  allowed  for  completion  of  the  section .  Table  3  provides  the  various  orders  of 
presentation  of  the  two  MCAT  versions  to  the  subjects. 

The  ATC  candidates  were  also  administered  at  least  one  of  the  ten  versions  of 
the  OKT .  All  OKT  tests  had  100  multiple  choice  items  with  the  exception  of  OKT 
101C ,  which  had  59  scored  questions .  The  test  had  a  45  minute  time  limit. 

RESULTS 

Tests  and  Questionnaire:  Subjects'  first  MCAT  (MCAT1)  ,  second  MCAT  (MCAT2) 
and  OKT  test  sheets  were  optically  scanned  and  computer  scored.  A  total  of  1,954 
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Table  1 


Subjects  Excluded  from  Study 


REASON  N 


ONLY  ONE  TEST  TAKEN  32 

ONLY  ONE  MCAT  TAKEN  87 

NO  OKT  TAKEN  391 

MCAT  VERSION  UNKNOWN  6 

OKT  VERSION  UNKNOWN  ■  74 

NO  NAME  OR  IDENTIFICATION  NUMBER  18 

INVALID  6 

TOTAL  DROPPED 


614 


Table  2 


Gender  -  By  Race 


FREQUENCY 

ROW  PERCENT 
COLUMN  PERCENT 

MALE 

FEMALE 

TOTAL 

CAUCASIAN 

1447 

300 

1747 

82.8% 

17.2% 

89.4% 

89.9% 

86.9% 

BLACK. 

98 

38 

136 

72.1% 

27.9% 

7.0% 

6.0% 

11.0% 

OTHER 

64 

7 

71 

91.1% 

9.9% 

3.6% 

3.9% 

2.0% 

TOTAL 

1609 

345 

1954 

82.3% 

17.7% 

100.0% 

MISSING  DATA  = 

545 

4 


Table  3 


Order  of  MCAT  Presentations 


MCAT1  MCAT 2 


4e6o 

4o6e 

8e7o 

8o7e 

8o7e(B) 

8o7e(C) 

8o7e(D) 

7e4o 

7o4e(D) 

7o4e 


4o6e 

7e4o(D) 

7o4e 

4e6o 

6o7e 

8o7e 

6e7o 

7e4o 

4o6e 

6o7e  (C) 
6o7e  (D) 
7o4e 

7o4e 

6e7o 

7o4e 

4e6o 

6o7e  (D) 
7e4o 
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FIGURE  1 


DIRECTIONS 

THE  MULTIPLEX  CONTROLLER  APTITUDE  TEST 


Aircraft 

Altitude 

Speed 

Route 

10 

7000 

430 

AGKHC 

20 

7000 

430 

B  G  JEe- 

30 

7000 

240 

A  G  J  E 

40 

6500 

240 

C  H  K  J  F 

50 

6500 

24G 

DIKOB 

60 

8000 

480 

D  I  K  J  E 

70 

8000 

480 

F  JKID 

0  4  8  12 


MILEAGE  SCALE 


QUESTION  WILL  APPEAR  HERE 


In  this  tost  you  will  observe  pictures  of  a  simulated  radar  scope  with  aircraft 
moving  across  it.  Your  task  will  be  to  observe  these  aircraft,  evaluate  their 
flight  information  as  given  in  a  table  to  the  left  of  the  scope .  read  questions 
which  appear  below  the  table,  and  record  your  answers  to  the  questions  on 
a  separate  answer  sheet. 
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subjects'  MCAT  and  OKT  test  scores  were  merged  with  background  questionnaire 
responses  and  ATC  school  data  extracted  from  the  Civil  Aeromedical  Institute's  data 
base.  There  are  four  ATC  options ,  which  include  Air  Route,  Traffic  Central  Center 
(Enroute) ,  IFR  (Instrument  Flight  Rules) ,  VFR  (Visual  Flight  Rules) ,  and  FSS  (Flight 
Service  Station) .  The  FAA  treats  IFR  and  VFR  as  one  Option,  identified  as  Terminal. 
The  hierarchy  of  lowest  to  highest  complexity  of  Options  is  FSS ,  VFR,  IFR ,  and  Enroute. 

Background  questionnaires  and  ATC  School  data  were  available  for  only  the 
Enroute  and  Terminal  Options.  The  proportion  of  subjects  in  each  Option  was 
approximately  equal;  49.4  percent  of  the  subjects  were  in  the  Enroute  phase  and 
50 . 6  percent  in  the  Terminal  phase .  Fifty  percent  of  the  males  were  in  each  phase , 
while  46.6  percent  of  the  females  were  in  Enroute  training  as  opposed  to  53.4  percent 
in  the  terminal  Option  (Table  4) .  There  was  no  statistically  significant  sex  preference 
between  the  Enroute  and  Terminal  Options  (X  2  (1)  =  1.34,  £  >  .05) . 

All  subjects  who  had  provided  education  information  met  the  minimum  requirement 
of  a  high  school  education  with  85.7  percent  having  at  least  some  college  training 
(Table  5) .  The  distribution  of  females  among  the  three  education  levels  was  not 
significantly  different  from  that  of  the  males  (x  2  (2)  =  5.58,  £>  0.05) .  However, 
the  males  had  significantly  greater  previous  ATC  or  related  experience  than  females 
(X  2  (2)  =  118.2,  £  <  0.01) .  Table  6  indicates  that  53.9  percent  of  the  males  had 
previous  ATC  experience ,  but  only  24.1  percent  of  the  females  had  any  ATC  back¬ 
ground. 

Test  Scores:  The  mean ,  standard  deviation ,  minimum ,  maximum ,  skewness ,  and 
kurtosis  were  computed  for  each  version  of  the  MCAT  for  both  the  first  (Table  7)  and 
the  second  (Table  8)  presentations  of  the  test.  All  of  the  MCAT1  tests  had  a 
negative  skew  (ranging  from  -0.17  to  -0.02)  indicating,  in  conjunction  with  the 
means  of  the  tests,  that  the  subjects  tended  to  score  toward  the  high  end  of  the  test 
scale.  The  same  held  true  for  the  MCAT 2  where  all  but  one  test  version  (MCAT 
6o7e  (B) )  had  greater  negatively  skewed  distributions  than  their  MCAT1  counterpart 
versions .  The  kurtosis  was  more  leptokurtic  for  the  MCAT2  as  opposed  to  the 
MCAT1  again,  except  for  6o7e(B) ,  which  became  slightly  more  platykurtic.  Thus, 
there  appeared  to  be  a  learning  effect  transferred  from  MCAT1  to  MCAT2  resulting 
in  higher  mean  scores  on  the  later  test. 

.  OKT  mean ,  standard  deviation ,  minimum ,  maximum ,  skewness ,  and  kurtosis  were 
also  calculated  (Table  9) .  There  were  negative  skew  for  most  of  the  OKT  tests  with 
the  exception  of  OKT  102B  and  OKT  102D .  This  skew  ranged  from  -0.68  to  0.19.  Kur¬ 
tosis  was  negative  (platykurtic)  except  for  positive  0.27  for  OKT  102E.  There  was  a 
more  uniform  distilbutlon  of  scores  for  the  OKT  than  for  the  MCAT  tests . 

The  test  scores  were  analyzed  at  the  request  of  the  FAA  by  Option ,  Education , 
Race,  and  Sex.  Table  10  presents  the  mean  score  and  standard  deviation  for  each 
of  the  three  FAA  tests  by  Option.  Those  subjects  in  the  Enroute  Option  received 
an  average  MCAT1  score  of  38.15,  which  was  found  to  be  significantly  higher  than 
the  mean  score  of  37.02  for  those  in  the  Terminal  Option  ft  (1886)  =  3.43,  £  <  .001) . 
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Table  4 


Option 

FREQUENCY 

ROW  PERCENT 

COLUMN  PERCENT 

MALE 

FEMALE 

TOTAL 

ENROUTE 

819 

182 

981 

83.4% 

16.5% 

49.4% 

50.0% 

46.5% 

TERMINAL 

820 

186 

1006 

81.5% 

18.5% 

50.6% 

50.0% 

53.4% 

TOTAL 

1639 

348 

1987 

82.5% 

17.5% 

100.0% 

, 

MISSING  DATA  - 

512 

J 


Table  5 


Education 


FREQUENCY 

ROW  PERCENT 

COLUMN  PERCENT 

MALE 

FEMALE 

TOTAL 

HIGH  SCHOOL 

204 

47 

251 

81. 3% 

18.7% 

100% 

14.1% 

15.1% 

14.3% 

SOME  COLLEGE 

705 

129 

834 

84.5% 

15.5% 

100% 

48.7% 

41.5% 

47.4% 

COLLEGE 

538 

135 

673 

79.9% 

20.1% 

100% 

37.2% 

43.4% 

38.3% 

TOTAL 

1447 

311 

1758 

82.3% 

17.7% 

100% 

100% 

100% 

MISSING  DATA 

=  741 
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Table  6 


Air  Traffic  Control  Previous  Experience 


FREQUENCY  '  - - 

ROW  PERCENT 

COLUMN  PERCENT  _ MALE  _ FEMALE 

NONE  403  179 

69.2%  30.8% 

28.0%  59.1% 

NON-ATC  231  51 

83.7%  1.6.4% 

18.1%  IS .8% 

ATC  775  73 

91-4%  8.8% 

53.9%  24.1% 

T0TAL  1439  303 

82.6%  17.4% 

100.0%  100.0% 


TOTAL 

582 

100.0% 

33.4% 

312 

100.0% 

17.9% 

848 

100.0% 

48.7% 

1742 

100.0% 


MISSING  DATA  =  757 


Table  7 


De«*c  dpt..*  Statistics: 

Multiplex  Controller  Aptitude  Test  -  Pa_^  '» 

fWP.TH 


TEST 


VERSION 

N 

MEAN 

S.D. 

MIN 

MAX 

SKEWNESS 

KURTOSIS 

4o6e 

354 

34.38 

6.70 

12 

50 

-0.26 

-0.16 

4e6o 

498 

35.50 

8.32 

6 

51 

-0.89 

0.98 

6o7e 

216 

39.33 

6.92 

20 

53 

-0.54 

-0.14 

6e7o 

498 

36.64 

6.32 

15 

52 

-0.17 

-0.09 

6o7e  (B) 

145 

39.47 

7.11 

19 

53 

-0.56 

-0.21 

6o7e(C) 

73 

40.67 

6.10 

26 

51 

-0.43 

-0.66 

6o7e(D) 

57 

31.65 

7.65 

11 

45 

-0.40 

-0.37 

7o4e 

124 

33.97 

7.91 

10 

51 

-0.47 

0.33 

7e4o 

481 

39.62 

7.15 

11 

52 

-0.02 

1.15 

7e4o  (D) 

48 

38.57 

9.19 

11 

51 

-0.89 

0.45 
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Table  8 


Descriptive  Statistics: 

Multiplex  Controller  Aptitude  Test  -  Part  2 
MCAT2 


TEST 

VERSION 

N 

MEAN 

S.D. 

MIN 

MAX 

SKEWNESS 

KURTOSIS 

4o6e 

382 

40.28 

5.62 

17 

52 

-0.69 

0.86 

4e6o 

115 

41.64 

6.43 

8 

51 

>1.70 

5.57 

6o7e 

785 

44.83 

5.51 

13 

54 

>1.41 

3.48 

8e7o 

183 

40.34 

6.15 

11 

54 

-0.77 

1.94 

6o7e(B) 

42 

44.80 

3.94 

35 

51 

-0.55 

-0.18 

6o7e(C) 

11.7 

45.74 

5.40 

18 

54 

-2.10 

6.77 

6o7e  (D) 

60 

36.32 

5.72 

20 

45 

-1.34 

1.38 

7o4e 

540 

41.66 

6.14 

8 

53 

-1.28 

3.11 

7e4o 

187 

43.63 

6.12 

11 

53 

-2.03 

6.72 

7e4o  (D) 

73 

36.84 

10.58 

8 

48 

-1.34 

0.88 

12 
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Table  9 


Descriptive  Statistics: 
Occupational  Knowledge  Test 
OKT 


TEST 

VERSION 

N 

MEAN 

S.D. 

MIN 

MAX 

SKEWNESS 

KURTOSIS 

102A 

41 

44.37 

10.55 

26 

67 

-0.06 

-0.88 

102B 

223 

35.37 

8.92 

15 

57 

0.19 

-0.67 

102C 

41 

46.15 

12.70 

19 

72 

-0.10 

-0.28 

102D 

125 

41.11 

11.96 

14 

71 

0.14 

-0.61 

102E 

222 

50.96 

13.57 

6 

87 

-0.31 

0.27 

ll'2F 

587 

46.41 

13.81 

7 

80 

-0.23 

-0.42 

102G 

170 

52.43 

15.12 

10 

81 

-0.35 

-0.68 

102H 

547 

51.80 

14.78 

4 

80 

-0.50 

-0.45 

101B 

138 

65.54 

16.41 

24 

89 

-0.88 

-0.51 

101C 

400 

41. 82 

9.59 

12 

58 

-0.65 

-0.17 

Table  10 


Test  Scores  by  Option 


ENROUTE 

(N=98CJ 

MEAN  S.D. 

TERMINAL 

(N=1006) 

MEAN  S.D. 

t 

t-TEST 

E 

MCAT1 

38.15 

7.38 

37.02 

7.33 

3.44 

<  .001 

MCAT2 

42.94 

6.15 

42.67 

6.47 

0.95 

ns 

OKT 

54.38 

19.42 

55.43 

18.23 

1.24 

ns 

ns  = 

nonsignificant 
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The  two  Options  had  average  test  scores  that  were  found  not  to  differ  statistically 
for  the  MCAT2  and  the  OKT . 

Subjects'  test  scores,  as  grouped  by  educational  levels  (high  school,  some 
college,  and  college  graduate) ,  are  presented  in  Table  11.  Those  subjects  with 
greater  educational  background  appeared  to  score  higher  than  those  with  only 
high  school  educations.  High  school  graduates  had  the  lowest  mean  score  for 
the  MGAT1  (X  =  37.05) ,  subjects  with  some  college  background  scored  only 
slightly  higher  (X  =  37.36)^  and  college  graduates  received  the  highest  mean 
score  of  all  three  groups  (X  =  38.01) .  The  same  apparent  relationship  between 
education  and  test  scores  also  held  true  for  the  MCAT2.  The  subjects  with  more 
education  scored  progressively  higher  on  the  MCAT1  and  the  MCAT2.  The  college 
graduates,  however,  had  a  lower  mean  score  (X  =  51.29)  than  subjects  in  the 
other  two  categories  for  the  OKT .  This  is  graphically  illustrated  in  Figure  2 . 

In  the  FAA  request  for  comparison  of  Race,  Caucasians  had  significantly 
higher  scores  than  Blacks  for  both  the  MCAT1  (t  (1881)  =  13.20,  £  <  .001)  and 
MCAT2  (t  (1881)  =  11.76,  ^  <  .001) .  Bach  mean,  standard  deviation,  and  t-test 
is  presented  in  Table  12 .  The  scores  from  the  OKT  were  not  significantly  different 
(1881)  =  0.16,  £>  0.05)  across  racial  background.  Of  those  tested,  63.4 
percent  successfully  completed  the  ATC  Academy .  Sixty-four  point  nine  percent  of  the 
Caucasians  ,  and  43.4  percent  of  the  Blacks,  passed  the  school  curricula  (Table 
13) .  There  was  a  significant  difference  in  the  proportion  of  pass/fail  between 
Caucasians  and  Blacks  (x  2  (1)  =  25.26,  £  <  0.001)  .  The  Blacks  incurred  higher 
attrition /failure  rate  in  the  ATC  Academy  than  the  Caucasians . 

The  jt-tests  performed  in  Table  14  detected  significant  differences  for  the 
MCAT1 ,  MCAT2  and  OKT  across  the  sexes.  Table  15  presents  the  crosstabulation 
of  success /failure  by  sex  in  the  FAA/ATC  Academy.  Of  the  63.2  percent  who 
successfully  completed  instruction,  84.1  percent  of  the  males  and  58.6  percent  of 
the  females  had  graduated  from  the  school.  Although  males  as  a  group  scored  higher 
on  the  three  selection  tests  than  females ,  no  significant  difference  in  the  proportion 
of  pass/fail  across  sex  was  found  (x  2  (1)  =  3.74,  £  >  0.05)  for  any  of  the  tests. 

Reliability .  The  internal  consistency  estimates  of  reliability  were  computed  for 
MCAT1  (Table  16)  ,  MCAT2  (Table  17)  ,  and  the  OKT  (Table  18)  .  Cronbach's 
coefficient  alpha,  a  measure  of  reliability  (8) ,  had  an  average  value  of  0.86  for 
MCAT1  (range:  0.80  to  0.91)  ,  0.80  for  MCAT2  (range  0.63  to  0.93)  ,  and  0.91  for 
OKT  (range  0.85  to  0.94) .  The  standardized  item  alpha  had  a  similar  calculated 
average  value  of  0.85  with  MCAT1  (range:  0.77  to  0.91) ;  MCAT2  with  0,81  average 
coefficient  (range:  0.84  to  0.93):  and  OKT  with  a  mean  coefficient  of  0.90  (range 
0.84  to  0.94) .  The  internal  consistency  appears  quite  adequate  with  the  exception 
of  MCAT2  Version  8o7e(B)  ,  which  had  a  reliability  coefficient  of  only  0.63 

Equivalence  of  Tests.  Analyses  of  variance  (Tables  19  through  21)  were  calculated 
to  investigate  the  comparability  of  the  versions  of  the  MCAT1 ,  MCAT2,  and  OKT . 

For  MCAT1 ,  F  (9,2484)  =  29.28,  <  .001;  for  MCAT2,  F  (9,2484)  =  34.4, 
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Table  11 

Test  Scores  by  Education 


HIGH  SCHOOL  SOME  COLLEGE  COLLEGE 

(N-251)  (N=834)  (N=673) 


MEAN 

S.D. 

MEAN 

S.D. 

MEAN 

S.D. 

MCAT1 

37.05 

7.53 

37.36 

7.48 

38.01 

7  14 

MCAT2 

42.18 

6.45 

42.69 

6.24 

43.18 

6.43 

OKT 

58.38 

17.34 

58.56 

18.95 

51.29 

19.28 

Mean  test  aeons  by  education  level 


Table  12 


Test  Scores  by  Race* 


CAUCASIAN 

U>1747) 

MEAN  S.D. 

BLACK 

(N-136) 

MEAN  S.D. 

t-TESTR 

t  E 

MCAT1 

38.26 

6.88 

30.04 

8.45 

13.20 

<  -001 

MCAT2 

43.33 

5.94 

37.04 

6.99 

11.76 

<  .001 

OKT 

55.27 

18.31 

55.01 

23.25 

0.16 

ns 

ns  =  nonsignificant 


♦Other  minorities  (N  =  71) :  analysis  not  done . 
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Table  13 


Success  in  FAA/ATC  Academy 
(By  Race) 


CAUCASIAN 

BLACK 

TOTAL 

PASS 

1134  (95.1%) 
(64.9%) 

59  (  4.9%) 
(43.4% 

1193  (63.4%) 

FAIL 

613  (Go. 8%) 
(35.1%) 

77  (11.2%) 
(56.6%) 

690  (36.6%) 

TOTAL 

1747 

136 

1883 

Other  Minorities  =  71 

Missing  Data  =  545 

f I 


Table  14 

Test  Scores  ty  Sex  Distribution 


- -  : 

MALE 

(N*1639) 

MEAN  S.D. 

FEMALE 

(N=348) 

MEAN  S  .D . 

t-TESTS  !j 

.  ^  !! 

MCAT1 

37.94 

7.18 

35.88 

8.03 

4.76 

.001 

J 

MCAT2 

43.11 

6.16 

41.37 

6.84 

4.69 

.001 

j 

OKT 

55.50 

18.88 

52.10 

18.37 

3.07 

.01 

i 


I 

t 

>  5 


I 

f. 


Table  16 


Multiplex  Controller  Aptitude  Test  -  PART  I 
(MCATl) 

Reliability  Coefficients 


VERSION 

CRONBACH  ALPHA 

STANDARDIZED  ITEM  ALPHA 

4o6o 

0.86 

0.85 

4e6o 

0.88 

0.88 

6o7e 

0.84 

0.83 

6e7o 

0.81 

0.78 

6o7e  (B) 

0.85 

0.85 

6o7e(C) 

0.80 

0.77 

6o7e(D) 

0.91 

0.91 

7o4e 

‘  0.38 

0.85 

7e4o 

0,87 

0.87 

7e4o(D) 


0.91 


0.91 


Table  17 


Multiplex  Controller  Aptitude  Test  -  PART  I 
(MCAT2) 

Reliability  Coefficients 


VERSION 

CRONBACH  ALPHA 

STANDARDIZED  ITEM  ALPHA 

4o6e 

0.79 

0.78 

4e6o 

0.81 

0.83 

6o7e 

0.79 

0.80 

6e7o 

0.81 

0.80 

6o7e  (B) 

0.63 

0.64 

6o7e  (C) 

0.80 

0.84 

6o7e  (D) 

0.83 

0.85 

7o4e 

0.81 

0.82 

7e4o 

0.83 

0.85 

7e4o(D) 

0.93 

0.93 

Table  18 


Occupational  Knowledge  Test 
(OKT) 

Reliability  Coefficients 


VERSION 

CRONBACH  ALPHA 

STANDARDIZED  ITEM  ALPHA 

102A 

0.85 

0.84 

102B 

0.90 

0.90 

102C 

0.90 

0.89 

102D 

0.90 

0.90 

102E 

0.90 

0.90 

102F 

0.91 

0.90 

102G 

0.92 

0.92 

102H 

0.92 

0.92 

101B 

0.94 

0.94 

101C 

0.90 

0.91 

24 


Table  19 


Analysis  of  Variance 

Multiplex  Controller  Aptitude  Test  -  Part  I 
(MCAT1) 


SOURCE 

df 

MS 

F 

E. 

MCAT1 

9 

1083.09 

29.28 

<  .001 

ERROR 

2484 

36.99 

25 


Table  20 


Analysis  of  Variance 

Multiplex  Controller  Aptitude  Test  -  Part  n 
(MCAT2) 


SOURCE 

df 

MS 

F 

E 

MCAT2 

9 

1221.72 

34.44 

<  .001 

ERROR 

1484 

35.47 

26 


I 

Table  21 


Analysis  of  Variance 
Occupational  Knowledge  Test  (102A-H) 

SOURCE  df  MS  F 

OKT  7  3637.67  20.05 


E 


.001 


ERROR 


1946 


181.41 


£  <  .001;  and  the  OKT  (F  value  calculated  for  all  versions  of  the  OKT  102  teat) 
was  F  (7,1948)  -  jd  <  .001.  There  are  statistically  significant  differences  among  the 
versions  of  the  three  FAA  selection  tests .  It  is  possible  that  some  differences  among 
the  test  versions  may  be  attributable  to  the  subject  distribution  among  the  tests.  The 
ratio  of  the  number  of  subjects  taking  one  test  version  as  compared  to  ancther  version 
was  as  high  as  10  to  1  for  MCAT1,  MCAT2,  and  OKT  (Tables  7,  8,  and  9)  . 

Item  Analyses.  Item  difficulty;  i.e. ,  percentage  of  subjects  who  answered  a 
question  correctly ,  was  calculated  for  each  item  for  each  version  of  each  test.  Appen¬ 
dices  A ,  B ,  and  C)  .  If  it  is  assumed  that  the  objective  of  the  tests  is  to  maximally 
discriminate  among  subjects,  the  test  items  that  most  subjects  answer  would  not  be 
very  useful  for  selection  purposes.  Likewise,  those  test  items  that  most  subjects 
could  not  answer  correctly  would  not  be  very  useful  selection  items .  It  is  assumed 
that  items  that  over  80  percent  of  the  subject  population  answer  correctly  and  those 
items  that  under  20  percent  of  the  subjects  answer  correctly  are  of  little  value  for 
ATC  selection  purposes  (9) .  Table  22  is  a  summary  of  Appendices  A  and  B ,  which 
list  the  item  difficulty  for  the  MCAT1  and  MCAT2.  This  table  lists  the  total  number 
of  test  items  that  over  80  percent  or  under  20  percent  of  the  subjects  answered 
correctly.  Across  all  versions  of  the  MCATl,  approximately  50  percent  of  all  items 
have  little  selection  utility.  For  the  MCAT2  over  56  percent  of  items  are  considered 
very  easy  or  very  difficult .  Table  23  is  analogous  to  Table  22  .providing  the  average 
test  item  difficulty  for  the  OKT  test  versions.  The  percentage  of  test  items  that  are 
of  limited  selective  value  is  smaller  for  the  OKT  than  for  the  MCAT .  This  finding 
is  consistent  with  the  premise  that  the  OKT  is  more  a  measure  of  ATC  job  experience 
than  a  measure  of  cognitive  capabilities  related  to  ATC  work. 

Those  subjects  who  had  received  the  top  25  percent  test  scores  were  compared  with 
those  who  were  in  the  bottom  25  percent  of  that  same  test  versions .  The  percentages 
of  subjects  answering  the  test  item  correctly  were  calculated  for  these  groups .  The 
difference  between  these  two  percentages  provides  an  "index  of  discrimination"  that 
is  independent  of  sample  size.  This  index  can  theoretically  range  between  +100  and 
-100.  The  index  of  discrimination  was  calculated  for  each  item  of  the  MCAT1 
(Appendix  D)  ,  MCAT  2  (Appendix  E)  ,  and  OKT  (Appendix  F)  .  A  summary  of  the 
means  and  ranges  of  the  indices  are  found  in  Tables  24  through  26.  The  range  of 
average  indices  was  27.93  to  38.62  for  MCAT1;  19.05  to  45.88  for  MCAT2;  and  29.25 
to  40.11  for  the  OKT. 

Regression  Analyses.  Subjects  were  divided  into  two  groups,  namely  Pass 
(those  who  had  passed  the  ATC  Academy)  and  Fail  (those  who  attrited  or  academically 
failed  the  Academy) .  Regression  analyses  of  each  tast  or  any  possible  combination 
thereof  on  this  Pasj/Fail  variable  were  conducted.  The  regression  of  all  three 
selection  tests  yielded  the  highest  multiple  linear  regression  coefficient  (r2  =  0.117) 
(Table  27) .  Each  test  variable  was  found  to  have  beta  weights  that  were  statistically 
different  from  zero.  MCAT1  =0.012,  MCAT 2  =  0.012,  OKT  =  0.003  (Table  28)  . 

The  subjects  were  then  divided  into  two  further  groups,  mtle  and  female. 

Table  29  shows  the  R2  for  prediction  of  Academy  Completion  of  males  to  be  equal  to 
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Table  22 


Table  23 


Occupational  Knowledge  Test 

Items  Answered  Correctly  by  Over  80  Percent 

or 

Under  20  Percent  of  the  Subjects 


VERSION 

N 

PERCENT  OF  TEST  ITEMS 

101  B 

35 

35 

101  c 

22 

37 

102  A 

22 

22 

102  B 

19 

19 

102  C 

25 

25 

102  D 

17 

17 

102  E 

21 

% 

21 

102  F 

19 

19 

102  G 

18 

18 

102  H 

19 

19 

AVERAGE 

22 

23 

30 


Table  24 


Multiplex  Controller  Aptitude  Test  -  Part  I 
(MCAT1) 

Index  of  Discrimination 


VERSION 

MEAN 

MINIMUM 

MAXIMUM 

4o6e 

33.87 

-4.32 

85.57 

4e6o 

38.62 

8.55 

88.89 

6o7e 

33.33 

-3.02 

89.49 

8e7o 

29.49 

-0.14 

83.58 

6o7e (B) 

33.07 

-2.63 

84.21 

6o7e (C) 

27.93 

-11.69 

89.47 

6o7e(D) 

41.81 

1.02 

100.00 

7o4e 

38.34 

0.86 

88.43 

7e4o 

31.52 

-2.18 

81.48 

7e4o(D) 

38.03 

-58.33 

91.67 
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Table  25 


Multiplex  Controller  Aptitude  Test  -  Part  II 
(MCAT2) 

Index  of  Discrimination 


VERSION 

MEAN 

MINIMUM 

MAXIMUM 

4o6e 

27.53 

-11.50 

75.06 

4e6o 

27.54 

-  1.33 

70.67 

6o7e 

19.05 

-11.11 

80.00 

6e7o 

27.04 

-17.39 

83.64 

6o7e(B) 

19.05 

-11.11 

60.00 

6o7e(C) 

23.18 

-14,52 

55.26 

6o7e(D) 

28.03 

-11.04 

85.71 

7o4e 

27.55 

-  0.11 

63.87 

7e4o 

23.53 

-  1.96 

65.38 

7e4o(D) 

45.88 

-40.00 

83.89 

V 
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Table  26 


Occupational  Knowledge  Test 
Index  of  Discrimination 


VERSION 

MEAN 

MINIMUM 

MAXIMUM 

102A 

29.25 

-24.44 

90.00 

102B 

32.65 

-37.17 

77.38 

102C 

35.44 

-30.00 

88.89 

102D 

35.05 

-17.10 

77.20 

102E 

32.55 

-23.24 

75.04 

102F 

35.10 

-37.03 

81.12 

102G 

39.28 

-30.83 

83.04 

102H 

37.33 

-11.86 

77.98 

101B 

37.90 

-52.33 

88.57 

101C 

40.92 

-  1.57 

71.32 
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Table  27 


Regression  Models 
for 

Dependent  Variable  (Pass/Fail) 


VARIABLES 

IN  MODEL 

R2 

MCAT1 

.085 

MCAT2 

.078 

OKT 

.024 

MCAT1  +  MCAT2 

.102 

MCAT1  +  OKT 

.101 

MCAT2  +  OKT 

.088 

MCAT1  +  MCAT2  OKT 

.117 

(N  =  1985) 
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Table  28 

Summary  Multiple  Linear  Regression  Predicting  Pass /Fail 
VARIABLE  COEFFICIENT  INCREASE  r2  r2  £ 

INTERCEPT  -0.507 


MCAT1 

0.012 

0.085 

0.085 

191.07 

< 

.0001 

MCAT2 

0.012 

0.017 

0.102 

37.51 

< 

.001 

OKT 

0.003 

0.015 

0.117 

33.47 

< 

.0001 

0.122.  The  multiple  regression  equation  is  as  follows:  (Pass/Fall)  (Males)  = 

(0.012)  MCAT1  +  (0.013)  MCAT2  +  (0.003)  (OKT)  -0.575,  Table  23  shows  all  beta 
weights  as  statistically  significant.  For  the  females,  r2  =  0.090,  but  only  MCAT1 
had  a  beta  weight  that  was  statistically  different  from  zero  ^Table  30) .  That  is , 

MCAT2  and  OKT  were  not  able  to  add  to  the  predictive  power  of  the  multiple 
regression  equation  for  female  ATC  candidates . 

Another  division  of  the  subject  population  was  conducted  for  Caucasian  and 
Black  subgroupings .  For  the  Caucasian  subgroup  R^  =  0.096,  and  for  the  Black 
subgroup  the  R^  =  0.188.  Table  31  shows  the  F  tests  are  significant  for  the  three 
selection  tests  for  the  Caucasians.  However,  only  the  MCAT1  has  a  significant  F 
test  for  the  Black  subgroup  (Table  32) . 

DISCUSSION 

Tests  and  Questionnaires.  The  ATC  sample  sizes  and  background  data  were 
satisfactory  for  the  analyses.  The  distribution  of  subjects  among  Options  (Table 
4) ,  Education  (Tabic  5) ,  and  Experience  (Table  6)  is  similar  to  that  of  the  FAA 
1969*1970,  1973-1974,  and  1976  sample  ATC  populations  (3) .  The  total  number  of 
females  and  minorities  participating  in  the  study  was  equal  to  or  greater  than  that 
of  the  previous  studios  combined  (4) .  As  had  been  found  in  FAA/ATC  Specialists 
from  1969  to  1976  (10) ,  females  showed  lower  percentages  of  ATC  or  aviation 
experience  prior  to  acceptance  to  the  ATC  Academy.  This  population  sample  had 
a  greater  proportion  of  subjects  with  continuing  education  beyond  high  school.  The 
percentage  of  ATC  Specialists  with  only  a  high  school  education  was  34  percent  in 
1960-1970,  24  percent  in  1973-1974,  18  percent  in  1976  (11) ,  and  has  further 
decreased  to  14.3  percent  in  this  1978-1980  sample.  Those  subjects,  on  the  other 
hand,  who  have  a  Bachelor  Degree,  have  increased  from  10  percent  in  1969  to  the 
present  38.3  percent  in  1978-1980  (Table  5)  . 

Test  Scores.  The  subjects  utilized  in  this  study  had  already  passed  the  CSC  test 
selection  battery  before  being  administered  the  MCAT  and  OKT .  This  is  reflected 
in  the  negatively  skewed  distribution  of  scores  for  most  of  the  test  versions .  The 
increase  of  skew  from  MCAT1  to  MCAT2  indicates  that  the  test  format  was  unique  in 
that  a  learning  process  occurred  during  these  short-times  tests .  Tables  7  and  8 
indicate  an  increased  mean  test  score  from  first  to  second  presentation  of  the  paper- 
and-pencil  tests .  A  selection  of  personnel  by  improvement  in  test  score  between  MCAT1 
and  MCAT2,  rather  than  raw  scores  obtained  for  each  test,  may  be  a  better  predic¬ 
tive  measure  of  ability  to  learn  ATC  job  tasks .  OKT  distributions  were  not  as 
negativoly  skewed  as  those  of  the  MCAT ,  which  may  reflect  greater  differences 
among  subjects  with  respect  to  ATC  or  ATC-related  experience. 

There  appears  to  be  a  relationship  between  Education  Level  and  selection 
test  scores.  Th6  average  MCAT  scores  were  higher  with  increased  education.  This 
may  indicate  the  measurement  of  general  intelligence  traits  by  the  MCAT .  The  mean 
OKT  score ,  however ,  is  lower  for  the  college  graduates  with  respect  to  high  school 
and  Associate  Degree  subjects;  i.e. ,  college  graduates  have  less  Air  Traffic  Control 
experience  than  other  applicants  as  measured  by  the  OKT . 
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Table  29 


Summary  Multiple  Linear  Regression  Predicting  Pass/Fail 

(Male) 


VARIABLE 

COEFFICIENT.' 

F 

E 

INTERCEPT 

-0. 57j 

MCAT1 

0.012 

157.23 

<  0.0001 

MCAT2 

0.013 

37.37 

<  0.0001 

OKT 

0.003 

33.36 

<  0.0001 

TOTAL  R2 

=  ..122 
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Table  30 


Summary  Multiple  degression  Predicting  Pass/Fail 

(Female) 


VARIABLE 

COEFFICIENT 

F 

E 

INTERCEPT 

-0.257 

MCAT1 

0.013 

30.18 

<  0.0001 

MCAT2 

0.007 

2.11 

ns 

OKT 

0.002 

1.75 

ns 

ns  -  nonsignificant 

TOTAL  R2 

=  0.090 

Table  31 

Summary  Multiple  Regression  Predicting  Pass/Fail 
(Caucasian) 

VARIABLE 

COEFFICIENT 

F 

E 

INTERCEPT 

-0.485 

MCAT1 

0.012 

126.37 

<  0.0001 

MCAT2 

0.011 

27.64 

<  0.0001 

OKT 

0.003 

29.66 

<  0.0001 

TOTAL  R2 

=  0.096 
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Table  32 

Summary  Multiple  Regression  Predicting  Pass/Fail 

(Black) 


VARIABLE 

COEFFICIENT 

F 

_E. 

INTERCEPT 

0.642 

MCAT1 

0.013 

25.21 

<  0.0001 

MCAT2 

0.016 

3.79 

ns 

OKT 

0.002 

1.50 

ns 

ns  =  nonsignificant 

TOTAL  R2  = 

0.188 

It  was  found  that  the  two  minorities  included  in  this  study;  i.e. ,  Blacks  and 
females,  achieved  significantly  lower  scores  on  the  MCAT  than  Caucasians  and  males, 
respectively  (Tables  12  and  14) .  The  females  as  a  group,  however,  while  performing 
lower  than  males  on  the  selection  tests ,  did  not  have  a  higher  rate  of  failure  than 
the  males  (Table  15) .  The  Black  candidate's  lower  MCAT  score,  however,  appears 
to  correlate  directly  with  a  higher  failure  rats  than  that  found  for  the  Caucasians 
(Table  13) . 

Reliability .  The  internal  consistency  of  the  MCAT  and  the  OKT  is  quite  high. 

Most  reliability  coefficients  are  above  0.80  for  the  MCAT  (Tables  16  and  17)  and 
above  0.90  for  the  OKT  (Table  18) .  The  one  unacceptable  reliability  coefficient  for 
MCAT2 ,  Version  6o7e  (B) ,  may  in  part  be  caused  by  the  very  low  sample  size  of  42 , 
which  is  the  lowest  of  the  10  MCAT  tests  analyzed. 

Equivalence  of  Tests.  Analyses  of  variance  (Tables  19  thru  21)  show  significant  dif¬ 
ferences  among  the  test  versions  of  the  MCAT1,  MCAT2,  and  OKT,  possibly  in  part 
due  to  the  unequal  sample  sizes  among  the  test  versions.  There  may  be  a  "non- 
random"  distribution  of  subjects  among  the  tests.  The  gender  and  race  of  the 
applicant  have  been  shown  to  be  related  to  test  scores .  A  greater  proportion  ol 
minorities  taking  one  test  version  may  in  part  account  for  significant  test  score 
differences .  If  Academy  success  is  related  to  test  scores ,  there  may  also  be  an 
overburdening  of  attrites  in  only  a  few  of  the  test  versions .  As  has  been  noted , 
there  was  an  increased  score  from  MCAT1  to  MCAT2  for  most  subjects  which  was 
attributed  to  learning  of  the  test  scenarios.  There  may  be  a  powerful  order  effect 
influencing  test  outcome.  Table  3  shows  that  the  test  versions  were  not  administered 
to  counterbalance  for  any  possible  order  effect.  A  comparison  of  tests  with  approxi¬ 
mately  equal. subjects  for  counterbalanced  versions  to  compensate  for  the  Order  Effect 
can  determine  if  the  tests  are  truly  parallel . 

Item  Analyses.  Items  were  found  to  be  either  too  difficult  or  too  easy  for  over 
50  percent  of  the  MCAT  test.  The  OKT  had  a  lower ,  more  acceptable  percentage , 
with  all  OKT  102  test  versions  having  25  or  fewer  percent  easy/difficult  items. 
Appendices  A  and  B  pinpoint  the  test  items  likely  to  need  revision  or  elimination. 

For  example,  no  subjects  were  able  to  answer  Item  #2,  MGAT2,  Test  Version 
8o7e  (B) .  This  question  has  no  utility  for  selection  of  ATC  personnel  and  thus 
should  be  modified  or  eliminated.  Appendices  D  and  E  provide  the  relative  dis¬ 
criminating  power  of  each  test  item  independent  of  sample  size.  For  example,  the 
index  of  discrimination  for  OKT  Test  Version  102A,  Item  #2,  is  -8.89,  indicating 
that  the  bottom  quartile  subjects  performed  slightly  better  than  the  top  quartile 
subjects .  This  item  has  a  negative  relationship  to  the  OKT  total  test  score .  The 
relatively  poor  index  of  discrimination  and  large  number  of  easily  answered  items 
may  again  be  attributed  to  the  preselected  sample  population.  This  does  not, 
however ,  rule  out  the  MCAT  and  OKT  as  appropriate  selection  tools ,  but  rather 
indicates  that  more  revisions  of  the  test  instruments  are  required. 

Regression  Analyses.  Test  scores  for  the  MCAT1,  MCAT 2,  and  OKT  did  not  hav  i 
as  high  a  predictive  validity  of  success  versus  failure  in  the  FAA/ATC  student 
training  program  as  previous  pilot  studies  had  indicated  (2) .  Although  the  R^  were 
low  for  all  three  tests,  they  were  statistically  significant  at  the  £  <  .001  level  (Table 
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28) .  In  view  of  the  evidence  that  lower  scores  obtained  by  females ,  as  opposed 
to  males ,  did  not  mean  higher  female  attrition  rates ,  different  multiple  regression 
equations  for  prediction  of  ATC  success  rate  had  to  be  calculated .  For  the 
minorities  (female  and  Black)  the  regression  of  MCAT2  and  OKT  onto  the  pass/fail 
criteria  was  not  statistically  significant.  That  is,  MCAT2  and  OKT  do  not  add  any 
more  power  to  prediction  of  success  for  the  minorities  than  MCAT1  alone. 

The  lower  R2  may  be  attributed  to  several  intervening  factors.  They  are: 
(1)  possible  nonrandom  distribution  of  subjects  among  non- counterbalanced  test 
versions;  (2)  the  proportion  of  successful  to  attrite  subjects  departs  from  the  ratio 
of  0.50/0.50  attenuating  maximum  possible  correlation  and  thus  maximum  R2  of 
selection  test  scores;  and  (3)  the  population  samples  were  those  persons  who  had 
already  passed  the  FAA/ATC  selection  criteria.  This  should  be  considered  as  a 
nonrepresentative  sample  of  all  persons  who  might  apply  for  ATC  positions .  This 
sample  is  preselected ,  as  indicated  by  the  skew  and  kurtosis  of  test  results  for  the 
MCAT ,  with  a  resulting  attenuation  of  R2 . 


41 


SUMMARY 


A  study  of  prototype  selection  and  prediction  tests  for  Air  Traffic  Control 
personnel  was  conducted  utilizing  subjects  entering  the  FAA  Academy .  Each  sub¬ 
ject  was  tested  using  two  versions  of  the  Multiplex  Controller  Aptitude  Test  (MCAT1 
and  MCAT2)  and  the  Occupational  Knowledge  Test  (OKT) ,  providing  2,499  records 
for  analysis . 

Regression  analysis  indicated  that  the  predictive  validity  for  successful 
completion  of  the  FAA  ATC  curriculum  of  the  MCAT1 ,  MCAT2 ,  and  OKT ,  was 
significant  at  the  £  <  .001;  however,  the  R2  was  low.  Consideration  of  causes 
for  the  low  R2  includes  nonuniform  distribution  of  subjects  and  possible  presel¬ 
ection  as  the  population  samples  had  passed  the  previous  FAA/ ATC  entry  criteria. 

Item  analyses  indicated  the  MCAT  contained  very  difficult  or  very  easy  items 
in  over  50  percent  of  the  questions .  The  OKT  had  acceptable  levels  of  item 
difficulty  at  the  25  percent  level. 

Analyses  of  variance  of  the  versions  of  each  selection  test  MCAT1,  MCAT2 
and  OKT  Indicated  significant  difference  among  the  versions .  The  nonuniform- 
distribution  of  subjects  and  a  learning  effect  between  the  test  versions  were  con¬ 
sidered  as  contributing  to  these  differences . 

Analyses,  at  the  request  of* the  FAA,  of  the  education  level,  sex,  and  race 
for  the  prototype  selection  tests  found  that  MCAT  scores  were  higher  with  increased 
education ,  while  the  OKT  were  lower .  Additionally ,  females  scored  lower  than  males , 
but  did  not  have  a  higher  attrition  rate ,  Blacks  had  lower  MCAT  scores  than 
Caucasians ,  which  appeared  to  correlate  directly  with  attrition . 

RECOMMENDATIONS 

Revision  of  the  MCAT  and  OKT  should  be  conducted  to  improve  question  or 
item  utility  for  selection . 

Evaluate  test  versions  utilizing  a  random  distribution  with  more  uniform 
numbers  of  subjects  participating  in  each  test. 

The  learning  process  itself ,  between  sequential  tests  such  as  the  MCAT1  and 
MCAT2 ,  may  indicate  the  learning  capability  of  the  ATC  applicant.  The  predictive 
value,  utilizing  the  difference  between  test  scores,  should  be  further  evaluated 
between  series  of  tests . 

Analysis  of  the  predictive  utility  of  the  CSC  ATC  Aptitude  Test,  in  conjunc¬ 
tion  with  the  MCAT/OKT,  should  be  conducted  to  evaluate  the  cognitive  character¬ 
istics  required  for  successful  ATC  performance . 

Application  and  evaluation  of  the  prototype  tests  to  include  CSC ,  ASVAB , 

MCAT,  and  OKT,  should  be  further  evaluated  prospectively  utilizing  U.S.  Navy 
personnel  considered  for  selection  for  ATC  training . 
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APPENDIX  A 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
ITEM  DIFFICULTY 
Part  I 
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I 

) 

I 

r. 

i 

|  MULTIPLEX  CONTROLLER  APTITUDE  TEST 

VERSION: 

1  4o6e 

t 

PART:  I 


ITEM  DIFFICULTY  (%  correct) 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 

4e6o 


PART:  I 


ITEM  DIFFICULTY  (%  correct) 


1 

95.38 

20 

55.62 

38 

92.37 

2 

81.33 

21 

63.45 

39 

71.08 

3 

67.07 

22 

55.82 

40 

87.55 

4 

88.96 

23 

38.75 

41 

42.97 

5 

43.57 

24 

33.33 

42 

49.60 

6 

76.51 

25 

36.35 

43 

88.15 

7 

83.53 

26 

7.23 

44 

74.50 

8 

84.34 

27 

18.27 

45 

77.31 

9 

80.52 

28 

94.98 

46 

77.51 

10 

81.53 

29 

94.18 

47 

76.31 

11 

50.60 

30 

68.07 

48 

58.84 

12 

80.72 

31 

80.32 

49 

61.45 

13 

70.48 

32 

95.33 

50 

44.98 

14 

50.20 

33 

87.75 

51 

34.14 

15 

77.71 

34 

93.17 

52 

21.69 

16 

83.53 

35 

87.55 

53 

16.06 

17 

45.78 

36 

85.86 

54 

17.07 

18 

87.15 

37 

69.08 

55 

7.63 

19 

76.31 

46 


MULTIPLEX  CONTROLLER  APTITUDE  TEST. 


VERSION: 

6o7e 


PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

98.15 

20 

87.96 

38 

86.11 

2 

93.98 

21 

69.44 

39 

87.50 

3 

67.13 

22 

64.81 

40 

86.57 

4 

75.93 

23 

64.81 

41 

84.26 

5 

97.69 

24 

46.76 

42 

75.93 

6 

89.81 

25 

47.22 

43 

01.67 

>  7 

98.15 

26 

18.52 

44 

78.70 

8 

68.52 

27 

36.11 

45 

91.67 

g 

54.17 

28 

21.30 

46 

92.13 

10 

69.91 

29 

85.37 

47 

77.78 

n 

'  12 

93.98 

30 

95.83 

48 

64.81 

74.07 

31 

67.59 

49 

40.74 

13 

87.96 

32 

89.81 

50 

50.46 

14 

48.15 

33 

89.81 

51 

54.63 

15 

66.67 

34 

81.67 

52 

51.39 

16 

93.52 

35 

83.33 

53 

39.35 

17 

82.87 

36 

87,96 

54 

38.89 

18 

87.04 

37 

87.50 

55 

29.17 

19 

88.89 

! 

i:  ’ 

A  7 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 


6e7o 
PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

95.38 

20 

2 

81.73 

21 

3 

97.99 

22 

4 

91.77 

23 

5 

94.58 

24 

6 

91.57 

25 

7 

67.47 

26 

8 

89.16 

27 

9 

51.41 

28 

10 

89.36 

29 

11 

92.57 

30 

12 

79.52 

31 

13 

70.08 

32 

14 

91.16 

33 

15 

85.54 

34 

16 

52.41 

33 

17 

84.54 

36 

18 

33.13 

37 

19 

44.98 

60.04 

38 

89.96 

71.69 

39 

82.73 

56.22 

40 

96.18 

30.32 

41 

71.08 

58.23 

42 

93.78 

53.82 

43 

60.24 

43.17 

44 

63.25 

40.76 

45 

52.41 

98.80 

46 

73.90 

97.99 

47 

29.92 

86.14 

48 

52.61 

95.98 

49 

37.35 

96.99 

50 

37.55 

73.69 

51 

17.87 

89.36 

52 

28.31 

69.28 

53 

17.07 

77.91 

54 

16.87 

73.49 

55 

10.24 

48 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


6o7e  (b) 

PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

96.55 

20 

88.97 

38 

89.66 

2 

98.62 

21 

68.97 

39 

93.10 

3 

59.31 

22 

73.79 

40 

84  83 

4 

73.10 

23 

68.28 

41 

86.21 

5 

95.86 

24 

55.17 

42 

77.24 

6 

93.79 

25 

50.34 

43 

91.03 

7 

97.24 

26 

22.76 

44 

81.38 

8 

71.03 

27 

5.52 

45 

38.97 

9 

55.86 

28 

26.21 

46 

91.03 

10 

66.90 

29 

90.34 

47 

79.31 

11 

93.79 

30 

94.48 

48 

74.48 

12 

60.00 

31 

65.52 

49 

46.21 

13 

85.52 

32 

77.93 

50 

53.79 

14 

45.52 

33 

86.21 

51 

0.00 

15 

56.55 

34 

91.72 

52 

60.69 

16 

91.03 

35 

85.52 

53 

48.28 

17 

86.21 

36 

85.52 

54 

42.07 

18 

86.21 

37 

91.03 

55 

30.34 

19 

86.90 

49 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST  j 

!J 

VERSION:  i  1 

''  I 

6o7e(c) 

j 

PART:  I  '  j 

)| 


ITET  DIFFICULTY  (%  correct) 


1 

100.00 

20 

90.41 

38 

89.04 

2 

95.89 

21 

73.97 

39 

89.04 

3 

56.16 

22 

72.60 

40 

91.78 

4 

73.97 

23 

61.64 

41 

90.41 

5 

94.52 

24 

53.42 

42 

79.45 

6 

84.93 

25 

52.05 

43 

95.89 

7 

97.26 

26 

15.07 

44 

86.30 

8 

73.97 

27 

2.74 

45 

90.41 

9 

50.68 

28 

27.40 

46 

90.41 

10 

71.23 

29 

91.78 

47 

80.82 

11 

90.41 

30 

98.63 

48 

73.97 

12 

73.97 

31 

57.53 

49 

52.05 

13 

80.82 

32 

90.41 

50 

57.53 

14 

50.68 

33 

97.28 

51 

56.16 

15 

67.12 

34 

94.52 

52 

57.53 

16 

97.26 

35 

82.19 

53 

43.84 

17. 

89.04 

36 

87.67 

54 

45.21 

18 

86.30 

37 

90.41 

55 

32.68 

19 

90.41 

I 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


7o4e 
PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

98.39 

20 

37.10 

38 

82.26 

2 

95.97 

21 

63.71 

39 

61.29 

3 

84.68 

22 

42.74 

40 

81.45 

4 

91.94 

23 

44.35 

41 

80.65 

E 

95.97 

24 

25.81 

42 

b2 .10 

6 

58.87 

25 

41.94 

43 

66.94 

7 

84.68 

26 

32.26 

44 

81.45 

8 

60.48 

27 

33.06 

45 

56.45 

9 

54.84 

28 

24.19 

46 

73.39 

10 

78.23 

29 

92.74 

47 

62.10 

11 

86.29 

30 

B1.45 

48 

47.58 

12 

79.84 

31 

69.35 

49 

49.19 

13 

95.16 

32 

87.10 

50 

32.26 

14 

57.26 

33 

51.61 

51 

20.16 

15 

88.71 

34 

70.97 

52 

12.10 

16 

60.48 

35 

80.65 

53 

16.13 

17 

50.00 

36 

91.13 

54 

2.42 

18 

50.00 

37 

79.03 

55 

6.45 

19 

81.45 

51 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


7e4o 
PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

94.39 

20 

85.45 

38 

61.12 

2 

94.59 

21 

47.40 

39 

92.72 

3 

49.69 

22 

65.49 

40 

10.81 

4 

87.53 

23 

78.92 

41 

87.53 

5 

78.59 

24 

79.63 

42 

65.07 

6 

89.81 

25 

65.28 

43 

49.69 

7 

86.69 

28 

66.11 

44 

55.09 

8 

86.90 

27 

58.63 

45 

77.34 

9 

90.85 

28 

96  88 

46 

82.74 

10 

91.27 

29 

83.56 

47 

77.34 

11 

87.32 

30 

81.27 

48 

54.47 

12 

84.41 

31 

82.72 

49 

35.97 

13 

86.69 

32 

93.76 

50 

34.72 

14 

81.29 

33 

89.81 

51 

25.99 

15 

92.93 

34 

89.19 

52 

16.84 

16 

82.33 

35 

84.82 

53 

15.38 

17 

96.26 

36 

92.93 

54 

7.90 

18 

98.67 

37 

88.57 

55 

10.19 

19 

84.20 

52 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 

7e4o  (D) 

PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

89.58 

20 

2 

93.75 

21 

3 

47.92 

22 

4 

72.92 

23 

5 

68.75 

24 

6 

60.42 

25 

7 

83.33 

26 

8 

75.00 

27 

9 

72.92 

28 

10 

91.67 

29 

11 

81.25 

30 

12 

72.92 

31 

13 

79.17 

32 

14 

72.92 

33 

15 

72.92 

34 

16 

83.33 

35 

17 

50.00 

36 

18 

83.33 

37 

19 

79.17 

54.17 

38 

68.75 

33.33 

39 

87.50 

50.00 

40 

12.50 

47.92 

41 

75.00 

16.67 

42 

62.50 

31.25 

43 

37.50 

27.08 

44 

58.33 

10.42 

45 

68.75 

93.75 

46 

66.67 

87.50 

47 

70.83 

87.50 

48 

31.25 

87.50 

49 

25.00 

87.50 

50 

31.25 

72.92 

51 

12.50 

79.17 

52 

10.42 

B9.58 

53 

10.42 

81.25 

54 

4.17 

81.25 

55 

6.25 

53 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


6o7e  (D' 

PART:  I 

ITEM  DIFFICULTY  (%  correct) 


1 

96.49 

20 

87.72 

38 

94.74 

2 

91.23 

21 

71.93 

39 

89.47 

3 

68.42 

22 

66.67 

40 

82.46 

4 

75.44 

23 

56.14 

41 

80.70 

5 

96.49 

24 

36.84 

42 

78.95 

6 

87.72 

25 

42.11 

43 

85.96 

7 

92.98 

26 

10.53 

44 

78.95 

8 

63.16 

27 

31.58 

45 

52.63 

9 

50.88 

28 

10.53 

46 

77.19 

10 

71.93 

29 

92.98 

47 

70.18 

11 

92.98 

30 

92.98 

48 

47.37 

12 

78.95 

31 

64.91 

49 

42.11 

13 

84.21 

32 

80.70 

50 

40.35 

14 

45.61 

33 

94.74 

51 

38.60 

15 

63  16 

34 

71.93 

52 

8.77 

16 

94.74 

35 

89.47 

53 

19.30 

17 

82.46 

36 

87.72 

54 

15.79 

18 

80.70 

37 

78.95 

55 

10.53 

19 

85.86 

54 


APPENDIX  B 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
ITEM  DIFFICULTY 
PART  II 


55 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

4e6o 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

96.52 

20 

68.09 

38 

97.39 

2 

94.78 

21 

85.22 

39 

66.96 

3 

66.09 

22 

81.74 

40 

90.43 

4 

88.57 

23 

61.74 

41 

51.30 

5 

58.26 

24 

61.74 

42 

40.87 

6 

75.65 

25 

74.78 

43 

96.52 

7 

66.96 

26 

23.48 

44 

86.96 

8 

87.83 

27 

60.00 

45 

88.70 

9 

91.30 

28 

94.78 

46 

88.70 

10 

86.96 

29 

94.78 

47 

92.17 

11 

60.87 

30 

69.57 

48 

78.26 

12 

87.83 

31 

85.22 

48 

82.61 

13 

75.65 

32 

97.38 

50 

71.30 

14 

70.43 

33 

87.83 

51 

57.39 

15 

80.00 

34 

94.78 

52 

49.57 

16 

94.78 

35 

92.17 

53 

31.30 

17 

53.91 

36 

64.35 

54 

47.83 

18 

95.65 

37 

71.30 

55 

38.26 

19 

87.83 

56 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


4o6e 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

97.96 

20 

2 

90.56 

21 

3 

92.60 

22 

4 

96.17 

23 

5 

94.13 

24 

6 

85.20 

25 

7 

86.99 

26 

8 

81.38 

27 

9 

91.84 

28 

10 

91.33 

29 

11 

59.18 

30 

12 

87.76 

31 

13 

12.50 

32 

14 

63.87 

33 

15 

57.40 

34 

16 

48.47 

35 

17 

65.05 

36 

18 

86.48 

37 

19 

96.17 

93.62 

38 

87.24 

73.47 

39 

96.68 

54.34 

40 

85.71 

64.29 

41 

75.00 

59.18 

42 

94.13 

63.01 

43 

89.29 

72.19 

44 

53.83 

48.21 

45 

85,46 

66.84 

46 

38.78 

96.94 

47 

39.29 

75.26 

48 

66.84 

98.98 

49 

80.36 

92.35 

50 

58.42 

94.39 

51 

39.54 

96.17 

52 

71.94 

70.41 

53 

61.22 

85.20 

54 

49.74 

57.65 

55 

46.43 

57 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 

6o7e 

PART:  II 


ITEM  DIFFICULTY  (%  correct) 


1 

98.60 

20 

2 

96.94 

21 

3 

67.01 

22 

4 

82.04 

23 

5 

98.34 

24 

6 

91.08 

25 

7 

96.82 

26 

8 

88.41 

27 

9 

67.01 

28 

10 

73.38 

29 

11 

94.90 

30 

12 

72,61 

31 

13 

91.08 

32 

14 

57.71 

33 

15 

55.41 

34 

16 

96.89 

35 

17 

90.19 

36 

18 

90.32 

37 

19 

95.92 

97.32 

38 

91.59 

77.96 

39 

91.21 

81.53 

40 

90.45 

80.00 

41 

89.81 

70.57 

42 

80.25 

79.75 

43 

95.54 

26.75 

44 

87.01 

74.65 

45 

96,82 

56.69 

46 

97.45 

93.76 

47 

87.13 

95.80 

48 

82.93 

62.80 

49 

55.67 

85.35 

50 

70.45 

93.89 

51 

80.89 

94.90 

52 

83.69 

84.59 

53 

74.65 

88.15 

54 

74.39 

93.38 

55 

62.68 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 


6e7o 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


97.27 

20 

71.04 

38 

84.70 

21 

90.16 

39 

97.81 

22 

73.22 

40 

90.16 

23 

53.01 

41 

96.17 

24 

88.52 

42 

91.80 

25 

79.23 

43 

73.77 

26 

68.31 

44 

87.98 

27 

77.60 

45 

60.66 

28 

98.36 

46 

91.80 

29 

38.91 

47 

99.45 

30 

82.51 

48 

9.84 

31 

97.27 

49 

73.22 

32 

95.08 

50 

94.54 

33 

72.13 

51 

74.32 

34 

94.54 

52 

53.55 

35 

67.21 

53 

90.71 

36 

79.78 

54 

43.72 

37 

74.86 

55 

47.54 

89.07 

79.23 

96.72 

66.67 

96.17 

52.46 

72.13 
48.63 
89.07 
36.61 
68.31 
59.56 
62.84 
38.25 
51.37 
39.34 
37.16 

25.14 


59 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

6o7e (B) 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

90.48 

20 

90.48 

38 

90.48 

2 

97.62 

21 

85.71 

39 

88.10 

3 

64.29 

22 

95.24 

40 

90.48 

4 

73.81 

23 

80.95 

41 

90.48 

5 

95.24 

24 

73.81 

42 

73.81 

6 

90.48 

25 

88.10 

43 

100,00 

7 

95.24 

26 

26.19 

44 

92.86 

8 

92.86 

27 

9.52 

45 

100.00 

9 

54.76 

28 

59.52 

46 

100.00 

10 

90.48 

29 

92.86 

47 

92.86 

11 

92.86 

30 

97.62 

48 

95.24 

12 

69.05 

31 

52.38 

49 

64.29 

13 

90.48 

32 

85.71 

50 

71.43 

14 

64.29 

33 

92.86 

51 

2.38 

15 

69.05 

34 

100.00 

52 

88.10 

16 

97.62 

35 

85.71 

53 

90.48 

17 

90.48 

36 

88.10 

54 

76.19 

18 

95.24 

37 

100.00 

55 

66.67 

19 

97.62 

60 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

6o7e (C) 

PART:  II 


ITEM  DIFFICULTY  (%  correct) 


I 

I 


1 

100.00 

20 

98.29 

38 

82.05 

2 

100.00 

21 

78.63 

39 

90.60  I 

3 

75.21 

22 

88.03 

40 

34.62 

4 

69.23 

23 

82.91 

41 

93.16  ; 

5 

98.29 

24 

70.09 

42 

80.34 

6 

91.45 

25 

88.03 

43 

97.44  , 

7 

94.87 

26 

35.04 

44 

88.89  j; 

8 

94.02 

27 

12.82 

45 

99.15 

9 

65.91 

28 

72.65 

46 

97.44 

10 

77.78 

29 

96.58 

47 

83.76  | 

11 

93.16 

30 

94.02 

48 

86.32 

12 

65.81 

31 

64.96 

49 

61.54 

13 

88.03 

32 

88.03 

50 

80.34 

14 

52.99 

33 

92.31 

51 

89.74 

15 

50.43 

34 

94.87 

52 

92.31  j! 

16 

94.02 

35 

83.76 

53 

89.74 

17 

89.74 

36 

88.03 

54 

84.62  j 

18 

93.16 

37 

95.73 

55 

77.78  | 

19 

94.87 

1 

J 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

6o7e  (D) 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
LI 
L2 
L3 
L4 
L5 
L6 

17 

18 
19 


100.00 

95.00 

66.67 
75.00 

100.00 

86.67 
90.00 

86.67 

58.33 

73.33 
95.00 

73.33 
88.38 

53.33 
45.00 

91.67 

81.67 

91.67 

98.33 


20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 


100.00 

78.33 
86.68 
70.00 
66.67 

83.33 

43.33 
70.00 
65.00 

93.33 
90.00 
70.00 
75.00 
98.55 

78.33 

78.33 

33.33 
90.00 


38 

39 

40 

41 

42 

43 

44 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 


90.00 

90.00 

81.67 

76.67 

73.33 
95.00 

88.33 
55.00 

91.67 

81.67 

81.67 

41.67 

58.33 

71.67 

18.33 

53.33 
50.00 
45.00 


62 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

7e4o 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

95.19 

20 

2 

97.33 

21 

3 

67.91 

22 

4 

90.91 

23 

5 

89.84 

24 

6 

94.12 

25 

7 

82.35 

26 

8 

83.42 

27 

9 

91.44 

28 

10 

93.05 

29 

11 

89.84 

30 

12 

86.10 

31 

13 

83.42 

32 

14 

82.89 

33 

15 

91.98 

34 

16 

85.56 

35 

17 

97.86 

36 

18 

97.33 

37 

19 

86.63 

88.24 

38 

66.84 

50.80 

39 

90.91 

79.68 

40 

12.30 

93.05 

41 

85.56 

95.72 

42 

66.84 

72.73 

43 

45.99 

89.30 

44 

65.78 

90.37 

45 

83.96 

96.26 

46 

93.05 

89.84 

47 

90.91 

91.98 

48 

69.52 

91.98 

49 

49.20 

98.79 

50 

58.29 

90.37 

51 

54.55 

93.05 

52 

48.13 

84.49 

53 

49.20 

92.51 

54 

29.95 

90.37 

55 

37.43 

63 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 


7o4e 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

98.33 

20 

39.44 

38 

86.85 

2 

99.07 

21 

30.56 

33 

53.89 

3 

87.22 

22 

73.89 

40 

87.22 

4 

96.67 

23 

86.67 

41 

79.81 

5 

97.04 

24 

53.70 

42 

62.41 

6 

70.74 

25 

90.56 

43 

83.33 

7 

89.07 

26 

74.07 

44 

95.00 

8 

70.00 

27 

82.04 

45 

97.04 

9 

74.63 

28 

70.74 

46 

96.48 

10 

75.19 

29 

95.93 

47 

83.07 

11 

89.26 

30 

87.96 

48 

67.96 

1? 

82.04 

31 

75.37 

49 

76.67 

13 

93.15 

32 

93.89 

50 

73.52 

14 

68.89 

33 

58.70 

51 

48.33 

15 

95.74 

34 

75.93 

52 

48.89 

16 

57.96 

35 

94.44 

53 

52.04 

17 

76.85 

36 

82.78 

54 

11.31 

18 

56.67 

37 

91.11 

55 

32.96 

19 

91.85 

I 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION: 

7a4o (D) 

PART:  II 

ITEM  DIFFICULTY  (%  correct) 


1 

84.93 

20 

72.60 

38 

56.16 

2 

82.19 

21 

42.47 

39 

84.93 

I  3 

49.32 

22 

58.90 

40 

20.55 

)  4 

78.08 

23 

71.23 

41 

75.34 

1  5 

78.08 

24 

36.99 

42 

58.90 

! 

6 

71.23 

25 

56.16 

43 

47.95 

'  1 

7 

75.34 

26 

67.12 

44 

50.68 

8 

71.23 

27 

61.64 

45 

68.49 

9 

79.45 

28 

83.56 

46 

68.49 

10 

71.23 

29 

80.82 

47 

79.45 

’  1  11 

76.71 

30 

73.97 

48 

61.64 

12 

76.71 

31 

83.56 

49 

38.36 

!  13 

75.34 

32 

83.56 

50 

45.21 

14 

61.64 

33 

78.08 

51 

43.84 

15 

91.78 

34 

78.08 

52 

31.51 

16 

75.34 

35 

76.71 

53 

39.73 

17 

41.10 

36 

79.45 

54 

21.92 

'  18 

91.78 

37 

79.45 

55 

26.03 

!  19  75.34 

i 

\  i 


( 


APPENDIX  C 

OCCUPATIONAL  KNOWLEDGE  TEST 
ITEM  DIFFICULTY 


OCCUPATIONAL  KNOWLEDGE 


VERSION:  OKT  101B 
ITEM  DIFFICULTY  (%  correct) 


1 

98.55 

26 

71.74 

51 

81.88 

76 

39.86 

2 

76.09 

27 

57.25 

52 

59.42 

77 

42.75 

3 

24.64 

28 

.72 

53 

81.16 

78 

66.67 

4 

89.13 

29 

95.65 

54 

89.86 

79 

18.12 

5 

92.03 

30 

13.04 

55 

56.52 

80 

78.99 

6 

97.83 

31 

89.86 

56 

12.32 

81 

34.78 

7 

79.71 

32 

54.35 

57 

61.59 

82 

52.90 

8 

64.49 

33 

91.30 

58 

43.48 

83 

67.39 

9 

68.84 

34 

72.46 

59 

62.32 

84 

50.72 

10 

71.01 

35 

52.90 

60 

24.64 

85 

76.09 

11 

98.55 

36 

50.72 

61 

50.00 

86 

86.96 

12 

68.84 

37 

78.26 

62 

60.14 

87 

52.90 

13 

96.38 

38 

83.33 

63 

67.39 

88 

59.42 

14 

42.75 

39 

47.83 

64 

84.78 

89 

92.75 

15 

75.36 

40 

84.78 

65 

10.14 

90 

62.32 

16 

93.48 

41 

57.25 

66 

84.06 

91 

67.39 

17 

80.43 

42 

74.64 

67 

54.35 

92 

.72 

18 

82.61 

43 

70.29 

68 

17.39 

93 

83.33 

19 

84.78 

44 

78.26 

69 

88.41 

94 

31.88 

20 

69.57 

45 

63.77 

70 

59.42 

95 

76.81 

21 

89.13 

46 

22.46 

71 

38.41 

96 

69.57 

22 

66.67 

47 

67.39 

72 

66.67 

97 

61.59 

23 

81.16 

48 

89.13 

73 

50.00 

98 

18.84 

24 

47.83 

49 

92.75 

74 

56.52 

99 

62.32 

25 

3.62 

50 

92.03 

75 

10.14 

100 

4.35 

67 


r 


OCCUPATIONAL  KNOWLEDGE 


99.25 
83.00 
97.00 

96.50 

89.75 

63.50 

78.25 

98.25 

61.50 

94.50 

49.50 

74.25 

82.25 

85.25 

69.75 

91.50 

80.25 

38.50 
63.00 

62.75 


VERSION:  OKT  101C 
ITEM  DIFFICULTY  (%  correct) 


21 

95.00 

22 

81.25 

23 

48.25 

24 

42.00 

25 

81.50 

26 

87.00 

27 

N/A 

28 

56.75 

29 

71.50 

30 

69.75 

31 

85.00 

32 

61.75 

33 

88.75 

34 

91.50 

35 

47.25 

38 

39.50 

37 

59.25 

38 

26.50 

39 

48.75 

40 

57.25 

41 

81.50 

42 

78.50 

43 

54.00 

44 

67.00 

45 

93.75 

46 

63.75 

47 

66.75 

48 

56.25 

49 

38.00 

50 

79.50 

51 

74.75 

52 

65.75 

53 

79,00 

54 

63.50 

55 

91.00 

56 

75.00 

57 

67.25 

58 

72.25 

59 

61.25 

60 

53.25 

68 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102A 
ITEM  DIFFICULTY  (%  correct) 


1  80.49 

2  12.20 

3  38.59 

4  26.83 

5  24.39 

6  78.05 

7  58.54 

8  51.22 

9  68.29 

10  56.10 

11  60.98 

12  82.93 

13  48.78 

14  34.15 

15  53.66 

16  31.71 

17  31.71 

18  73.17 

19  19 . 51 

20  29.27 

21  80.49 

22  75.81 

23  26.83 

24  31.71 

25  85.37 


26 

19.51 

27 

53.66 

28 

58.54 

29 

70.73 

30 

68.29 

31 

2.44 

32 

78.05 

33 

56.10 

34 

63.41 

35 

34.15 

36 

58.54 

37 

51.22 

38 

58.54 

39 

34.15 

40 

26.83 

41 

78.05 

42 

60. J8 

43 

31.71 

44 

29.27 

45 

73.17 

46 

39.02 

47 

12.20 

48 

39.02 

49 

31.71 

50 

9.76 

51 

63.41 

52 

85.37 

53 

39.02 

54 

43.90 

55 

24.39 

56 

24.39 

57 

73.17 

58 

63.41 

59 

31.71 

60 

73.17 

61 

46.34 

62 

48.78 

65 

36.59 

64 

26.83 

65 

46.34 

66 

38.02 

67 

19.51 

68 

29.27 

69 

24.39 

70 

63.41 

71 

56.10 

72 

12.20 

73 

46.34 

74 

60.98 

75 

9.76 

76 

46.34 

77 

75.61 

78 

14.63 

79 

60.98 

80 

75.61 

81 

34.15 

82 

4.88 

83 

34.15 

84 

73.17 

85 

48.78 

86 

60.98 

87 

31.71 

88 

19.51 

89 

56.10 

90 

36.59 

91 

14.63 

92 

9.76 

93 

39.02 

94 

12.20 

95 

53.66 

96 

51.22 

97 

63.41 

98 

34.15 

99 

17.07 

100 

63.41 

69 


OCCUPATIONAL  KNOWLEDGE 


VERSION:  OKT  102B 
ITEM  DIFFICULTY  (%  correct) 


1 

77.13 

26 

53.81 

51 

63.68 

76 

50.22 

2 

79.37 

27 

53.81 

52 

61.43 

77 

39.46 

3 

9.87 

28 

68.16 

53 

46.64 

78 

64.13 

4 

42.15 

29 

77.58 

54 

74.44 

79 

26.01 

5 

50.22 

30 

28.70 

55 

55.61 

80 

84.75 

6 

68.61 

31 

33.18 

56 

8.97 

81 

38.57 

7 

19.28 

32 

60.54 

57 

22.42 

82 

12.11 

8 

59.64 

33 

42.15 

58 

39.01 

83 

47.98 

9 

23.77 

34 

62.33 

59 

36.32 

84 

57.40 

10 

52.91 

35 

74.89 

60 

70.40 

85 

38.57 

11 

19.28 

36 

11.66 

61 

14.35 

86 

48.88 

12 

43.95 

37 

13.00 

62 

35.43 

87 

20.63 

13 

42.60 

38 

1.79 

63 

24.22 

88 

34.08 

14 

51.12 

39 

29.60 

64 

61.43 

89 

13.90 

15 

37.67 

40 

43.05 

65 

60.54 

90 

25.56 

18 

60.54 

41 

42.15 

66 

46.19 

91 

5.38 

17 

35.87 

42 

20.63 

67 

31.84 

92 

29.60 

18 

26.46 

43 

25.56 

68 

86.55 

93 

37.67 

19 

53.36 

44 

39.91 

69 

58.30 

94 

40.36 

20 

71.30 

45 

25.11 

70 

64.57 

95 

46.64 

21 

60.09 

46 

29.60 

71 

70.85 

96 

35.87 

22 

50.22 

47 

46.19 

72 

6.28 

97 

51.12 

23 

21.08 

48 

33.63 

73 

17.04 

98 

32.29 

24 

55.61 

49 

52.91 

74 

36.77 

99 

26.01 

25 

89.39 

50 

36.77 

75 

10.31 

100 

34.53 

70 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102C 


\ 

! 


I 


t 

ITEM 

DIFFICULTY 

1 

70.73 

26 

26.83 

2 

29.27 

27 

92.66 

3 

36.58 

28 

48.78 

4 

26.83 

29 

75.61 

5 

34.15 

30 

34.15 

6 

68.29 

31 

7.32 

7 

17.07 

32 

75.61 

8 

100.00 

33 

24.39 

9 

90.24 

34 

56.10 

10 

41.46 

35 

65.65 

;  11 

31.71 

36 

78.05 

12 

85.37 

37 

78.05 

13 

24.39 

38 

31.71 

14 

56.10 

39 

78.05 

i  16 

65.85 

40 

58.54 

16 

12.20 

41 

36.59 

17 

78.05 

42 

60.98 

18 

60.98 

43 

82.93 

,  19 

48.78 

44 

39.02 

20 

29.27 

45 

43.90 

21 

97.56 

46 

19.51 

22 

80.49 

47 

36.59 

23 

97.56 

48 

17.07 

24 

48.78 

49 

56.10 

25 

53.66 

50 

26.83 

I 

f 


(%  correct) 


51 

53.66 

76 

60.98 

52 

2.44 

77 

17.07 

53 

31.71 

78 

39.02 

54 

2.44 

79 

29.27  1 

55 

31.71 

80 

53.66 

56 

29.27 

81 

43.90 

57 

63.41 

82 

73.17 

58 

48.78 

83 

92.68 

59 

75.61 

84 

19.51 

60 

36.59 

85 

21.95 

61 

51.22 

86 

19.51  ' 

62 

73.17 

87 

48.78 

63 

7.32 

88 

65.85  '! 

64 

63.41 

89 

65.85 

65 

31.71 

90 

63.41 

66 

12.20 

91 

51.22  ! 

67 

39.02 

92 

39.02  ! 

68 

29.27 

93 

2.44 

69 

12.20 

94 

73.17 

70 

63.41 

95 

53.66  j 

71 

46.34 

96 

46.34  | 

72 

68.29 

97 

46.34 

73 

68.29 

98 

0.00  | 

74 

51.22 

99 

46.34 

75 

14.63 

100 

48.78 

1 
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L 


OCCUPATIONAL  KNOWLEDGE 
VERSION;  OKT  102D 
ITEM  DIFFICULTY  (%  correct) 


1 

24.00 

26 

51.20 

2 

36.80 

27 

33.60 

3 

56.00 

28 

51.20 

4 

81.60 

29 

36.00 

5 

38.40 

30 

64.80 

6 

55.20 

31 

38.40 

7 

42.40 

32 

76.80 

8 

39.20 

33 

14.40 

9 

46.40 

34 

80.80 

10 

45.60 

35 

26.40 

11 

46.80 

36 

51.20 

12 

78.40 

37 

20.80 

13 

60.00 

38 

33.60 

14 

72.00 

39 

82.40 

15 

56.00 

40 

95.20 

16 

53.60 

41 

34.40 

17 

52.00 

42 

88.80 

18 

64.80 

43 

36.00 

19 

80.80 

44 

16.80 

20 

29.60 

45 

41.60 

21 

20.00 

46 

28.80 

22 

12.00 

47 

11.20 

23 

20.80 

48 

68.00 

24 

36.00 

49 

54.40 

25 

26.40 

50 

44.00 

51 

61.60 

76 

72.80 

52 

92.80 

77 

43.20 

53 

49.60 

78 

60.00 

54 

20.80 

79 

28.80 

55 

44.00 

80 

39.20 

56 

16.00 

81 

5.63 

57 

41.60 

82 

36.00 

58 

56.00 

83 

13.60 

59 

69.60 

84 

39.20 

60 

48.00 

85 

48.80 

61 

48.00 

86 

51.20 

62 

72.00 

87 

33.60 

63 

34.40 

88 

40.00 

64 

41.60 

89 

26.40 

65 

40.00 

90 

34.40 

66 

1.60 

91 

44.80 

67 

31.20 

92 

36.00 

68 

48.00 

93 

61.60 

69 

52.00 

94 

28.00 

70 

87.20 

95 

17.60 

71 

34.40 

96 

48.80 

72 

47.20 

97 

26.40 

73 

29.60 

38 

47.20 

74 

85.60 

99 

32.  eo 

75 

76.80 

100 

56.80 

72 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102F 
ITEM  DIFFICULTY  (%  correct) 


1 

15.50 

26 

75.81 

2 

9.71 

27 

20.78 

3 

9.03 

28 

60.31 

4 

30.49 

29 

46.00 

5 

51.45 

30 

54.68 

6 

58.94 

31 

60.65 

7 

23.34 

32 

43.27 

8 

88.76 

33 

63.88 

g 

58.60 

34 

11.58 

10 

55.54 

35 

60.48 

n 

35.95 

36 

50.60 

12 

68.43 

37 

36.46 

13 

73.08 

38 

83.48 

14 

46.68 

39 

64.22 

15 

59.28 

40 

66.27 

16 

39.52 

41 

12.44 

17 

62.18 

42 

14.82 

18 

25.21 

43 

15.16 

19 

51.79 

44 

78.53 

20 

53.15 

45 

84.84 

21 

20.44 

46 

75.13 

22 

59.63 

47 

42.06 

23 

92.16 

48 

31.86 

24 

29.30 

49 

41.23 

25 

33.05 

50 

36.63 

51 

36.63 

76 

17.55 

52 

78.53 

77 

41.74 

53 

58.09 

78 

56.56 

54 

37.82 

79 

50.43 

55 

65.42 

80 

23.00 

56 

51.11 

81 

48.69 

57 

30.66 

82 

23.34 

58 

14.99 

83 

28.62 

59 

42.76 

84 

56.39 

CO 

42.93 

35 

24.36 

61 

72.06 

86 

28.11 

62 

13.12 

87 

70.70 

63 

26.92 

88 

44.79 

64 

56.90 

89 

68.65 

65 

83.30 

90 

65.76 

66 

76.83 

91 

59.45 

67 

81.09 

92 

30.66 

68 

48.72 

93 

9.03 

69 

42.25 

94 

62.86 

70 

33.39 

95 

26.24 

71 

24.70 

96 

55.03 

72 

19.42 

97 

53.83 

73 

36.29 

98 

46.85 

74 

35.09 

99 

56.39 

75 

87.05 

100 

18.06 

73 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102  G 
ITEM  DIFFICULTY  (%  correct) 


1 

62.35 

26 

23.53 

2 

50.59 

27 

41.18 

3 

61.18 

28 

15.88 

4 

65.29 

29 

82.94 

5 

70.00 

30 

45.29 

6 

47.65 

31 

97.06 

7 

52.35 

32 

81.18 

8 

70.00 

33 

53.53 

9 

68.24 

34 

34.12 

10 

56.47 

35 

60.00 

11 

41.18 

36 

57.65 

12 

10.00 

37 

29.41 

13 

68.82 

38 

44.71 

14 

60.59 

39 

31.18 

15 

55.29 

40 

37.65 

16 

51.18 

41 

90.00 

17 

82.35 

42 

7.06 

18 

96.47 

43 

51.76 

19 

18.24 

44 

85.88 

20 

68.24 

45 

30.59 

21 

71.76 

46 

70.59 

22 

19.41 

47 

58.82 

23 

55.88 

48 

45.29 

24 

94.12 

49 

82.94 

25 

57.06 

50 

58.24 

51 

55.29 

76 

80.00 

52 

51.18 

77 

77.65 

53 

27.06 

78 

60.59 

54 

49.41 

79 

60.59 

55 

53.53 

80 

25.88 

56 

40.00 

81 

55.88 

57 

37.65 

82 

51.18 

58 

52.35 

83 

61.18 

59 

28.82 

84 

57.06 

60 

75.29 

85 

60.00 

61 

68.24 

86 

78.24 

62 

72.35 

87 

59.41 

63 

69.41 

88 

7.06 

64 

88.41 

89 

34.71 

65 

72.94 

90 

75.29 

66 

50.59 

91 

19.41 

67 

65.29 

92 

38.82 

68 

30.59 

93 

44.12 

69 

71.18 

94 

14.12 

70 

30.59 

95 

26.47 

71 

63.53 

96 

60.00 

72 

20.59 

97 

5.29 

73 

33.53 

98 

26.47 

74 

32.35 

99 

40.00 

75 

46.47 

100 

44.71 

74 


I 

I 

I 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102  H 
ITEM  DIFFICULTY  (%  correct) 


1 

59.60 

26 

41.50 

51 

50.64 

76 

r  2 

58.68 

27 

64.53 

52 

29.80 

77 

3 

50.64 

28 

92.14 

53 

15.90 

78 

4 

24.68 

29 

18.46 

54 

46.62 

79 

5 

65.63 

30 

33.64 

55 

35.83 

80 

6 

55.39 

31 

77.88 

56 

49.35 

81 

7 

10.42 

32 

75.87 

57 

34.00 

82 

1  8 

87.57 

33 

36.56 

58 

72.03 

83 

9 

63.80 

34 

75.69 

59 

48.81 

84 

i  10 

77.15 

35 

94.15 

60 

70.93 

85 

11 

84.64 

36 

90.86 

61 

33.27 

86 

12 

24.13 

37 

63.44 

62 

69.84 

87 

13 

17.37 

38 

63.07 

63 

38.03 

88 

1  14 

k 

24.13 

39 

96.89 

64 

89.21 

89 

■  15 

47.35 

40 

75.69 

65 

77.88 

90 

16 

52.29 

41 

70.75 

66 

53.75 

91 

17 

59.05 

42 

45.16 

67 

77.70 

92 

,  18 

29.62 

43 

51.01 

68 

79.16 

93 

19 

87.39 

44 

8.23 

69 

78.43 

94 

20 

88.30 

45 

74.41 

70 

82.82 

95 

21 

56.86 

46 

29.43 

71 

58.14 

96 

22 

44.61 

47 

19.56 

72 

60.15 

97 

23 

33.27 

48 

56.12 

73 

64.17 

98 

,  24 

58.68 

49 

47.71 

74 

21.39 

99 

»  25 

f 

25.23 

50 

48.08 

75 

35.83 

100 

\ 


75 


33.27 

72.94 

53.02 

33.82 

42.60 

23.40 

34.00 

30.53 

72.21 

70.57 

42.60 

25.05 

69.29 

46.98 

77.15 

70.93 

22.12 

48.63 

61.06 

29.07 

16.09 

41.32 

3.47 

39.85 

9.51 


OCCUPATIONAL  KNOWLEDGE 
VERSION:  OKT  102  E 
ITEM  DIFFICULTY  (%  correct) 


1 

45.05 

2 

46.40 

3 

15.32 

4 

44.59 

5 

33.33 

6 

75.23 

7 

20.27 

8 

54.95 

9 

18.92 

10 

30.18 

11 

55.41 

12 

72.07 

13 

46.40 

14 

59.91 

15 

10.36 

16 

34.68 

17 

40.54 

16 

67.12 

19 

83.78 

20 

77.93 

21 

61.71 

22 

56.31 

23 

52.70 

24 

82.88 

25 

70.72 

26  94.59 

27  33.78 

28  47.30 

29  95.95 

30  39.64 

31  78.38 

32  32.43 

33  12.61 

34  44.59 

35  32.43 

36  72.07 

37  50.00 

38  25.23 

39  90.09 

40  12.61 

41  51.80 

42  30.18 

43  36.49 

44  11.26 

45  62.61 

46  50.90 

47  62.61 

48  77.93 

49  56.76 

50  54.95 


51 

44.14 

52 

50.45 

53 

46.85 

54 

40.99 

55 

32.43 

56 

77.93 

57 

54.95 

58 

66.67 

59 

18.02 

60 

40.09 

61 

48.65 

62 

93.24 

63 

63.06 

64 

72.97 

65 

85.59 

66 

70.72 

67 

48.20 

68 

16.22 

69 

88.74 

70 

65.32 

71 

58.76 

72 

32.43 

73 

68.47 

74 

42.34 

75 

56.76 

76 

77 

78 

79 

80 
81 
82 

83 

84 

85 
66 

87 

88 

89 

90 

91 

92 

93 

94 

95 

96 

97 

98 

99 
100 


38.49 

29.28 

17.57 

58.56 

59.46 

84.23 

27.93 

31.08 

20.72 

59.91 

80.18 

7.66 

20.27 

27.48 

41.44 

84.68 

81.88 

23.42 

31.53 

63.06 

65.77 
51.35 
39.64 
40.09 

15.77 
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APPENDIX  D: 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
INDEX  OF  DISCRIMINATION 
PART  I 


77 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  4e6o  PART:  I 


INDEX  OF 

DISCRIMINATION 

1 

8.55 

29 

14.53 

2 

18.80 

30 

21.36 

3 

17.10 

31 

32.48 

4 

16.24 

32 

14.53 

5 

24.79 

33 

12.82 

6 

19.65 

34 

12.8/ 

7 

31.63 

35 

17.10 

8 

20.52 

36 

32.48 

9 

28.20 

37 

36.75 

10 

17.95 

38 

18.81 

11 

33.34 

39 

21.37 

12 

29.06 

40 

27.35 

13 

20.52 

41 

17.95 

14 

39.31 

42 

27.35 

15 

29.06 

43 

40.17 

16 

41.03 

44 

41.88 

17 

39.32 

45 

64.10 

18 

45.30 

46 

70.94 

19 

64.11 

47 

73.51 

20 

58.12 

48 

75.21 

21 

70.08 

49 

88.89 

22 

81.20 

50 

86.32 

23 

68.38 

51 

78.64 

24 

65.81 

52 

58.12 

25 

73.51 

53 

34.19 

26 

14.53 

54 

48.72 

27 

48.72 

55 

17.10 

28 

13.67 

78 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 

4o6e  PART:  I 

< 

INDEX  OF 

DISCRIMINATION 

1 

5.06 

29 

3.12 

2 

24.26 

30 

6.55 

3 

29.02 

31 

4.17 

4 

8.63 

32 

6.40 

■  i 
1  i 

5 

12.95 

33 

11.46 

1 

6 

5.65 

34 

21.67 

7 

17.85 

35 

8.04 

8 

14.58 

36 

11.31 

9 

39.73 

37 

37.94 

10 

15.33 

38 

7.74 

11 

34.67 

39 

11.31 

12 

16.07 

40 

26.49 

•I 

13 

-4.32 

41 

20.53 

14 

28.42 

42 

18.90 

1 

15 

19.02 

43 

44,35 

16 

26.19 

44 

38.69 

r 

17 

47.02 

45 

56.10 

i 

18 

19 

73.51 

59.53 

46 

47 

39.58 

60.27 

i 

20 

77.08 

48 

72.62 

21 

69.34 

49 

85.57 

i 

22 

67.26 

50 

68.45 

23 

63.99 

51 

40.92 

24 

56.39 

52 

62.80 

j 

25 

58.77 

53 

57.58 

26 

46.13 

54 

40.78 

27 

25.15 

55 

32.44 

28 

29.46 

■ 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION:  6o7e  PART:  I 
INDEX  OF  DISCRIMINATION 


1 

6.00 

29 

2 

12.00 

30 

3 

2.34 

31 

4 

17.11 

32 

5 

0.00 

33 

6 

9.74 

34 

7 

-2.13 

35 

8 

45.74 

36 

9 

26.21 

37 

10 

22.85 

38 

11 

8.00 

39 

12 

23.62 

40 

13 

18,00 

41 

14 

5.06 

42 

15 

28.85 

43 

16 

19.87 

44 

17 

27.62 

45 

18 

27.87 

46 

19 

38.00 

47 

20 

39.87 

48 

21 

55.36 

49 

22 

71.74 

50 

23 

61.36 

51 

24 

52.09 

52 

25 

79.23 

53 

26 

25.66 

54 

27 

74.72 

55 

28 

45.19 

3.74 

6.00 

24,98 

18.00 

15.74 

17. 74 

19.49 

11.62 

21.74 
-3.02 

3.11 

23.87 

15.36 
19.11 
26.00 

46. 62 

27.87 

27.87 
53.  B7 

67.36 

66.34 

64.34 

85.74 

83.62 
83.23 

89.49 
72.60 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  6e7o  PART:  I 
INDEX  OF  DISC RIMINATION 


1 

3.79 

29 

-0.14 

2 

13.43 

30 

7.90 

3 

1.53 

31 

4.73 

4 

10.78 

32 

2.26 

5 

3.72 

33 

18.54 

6 

14.99 

34 

13.77 

7 

9.70 

35 

5.91 

8 

4.03 

36 

24.10 

9 

40.17 

37 

14.54 

10 

6.71 

38 

8.38 

11 

4.38 

39 

13.57 

12 

22.37 

40 

5.53 

13 

15.86 

41 

18.26 

14 

8.45 

42 

11.13 

15 

21.25 

43 

34.12 

16 

17.46 

44 

30.71 

17 

21.70 

45 

45.11 

18 

19.86 

46 

62.85 

19 

46.75 

47 

55.86 

20 

55.55 

48 

82.57 

21 

60.38 

49 

77.74 

22 

62.54 

50 

11.07 

23 

47.44 

51 

53.11 

24 

77.18 

52 

68.97 

25 

83.58 

53 

49.63 

26 

81.29 

54 

42.82 

27 

75.41 

55 

27.17 

28 

1.46 

81 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  607e(B)  PART:  I 
INDEX  OF  DISCRIMINATION 


1 

2.63 

29 

18.43 

2 

2.63 

30 

15.79 

3 

18.42 

31 

39.47 

4 

31.58 

32 

21.05 

5 

7.89 

33 

26.32 

6 

0.00 

34 

13.16 

7 

0.00 

35 

-2.63 

8 

28.95 

36 

10.52 

9 

13.15 

37 

23.69 

10 

28.95 

38 

7.89 

11 

7.89 

39 

13.16 

12 

15.79 

40 

26.32 

13 

31.58 

41 

31.58 

14 

23.69 

42 

39.48 

15 

10.53 

43 

28.95 

16 

23.68 

44 

34.22 

17 

26.32 

45 

36.84 

18 

26.32 

46 

31.58 

19 

47.37 

47 

60.53 

20 

34.21 

48 

57.90 

21 

47.37 

49 

63.16 

22 

36.84 

50 

65.79 

23 

85.79 

51 

68.42 

24 

71.06 

52 

71.05 

25 

71.05 

53 

81.58 

26 

34.21 

54 

84.21 

27 

13.16 

55 

73.69 

28 

55.27 

82 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION: 

6o7e  (C j  PART: 

I 

INDEX  OF  DISCRIMINATION 

1 

0.00 

29 

20.76 

2 

-5.85 

30 

-5.56 

3 

35.67 

31 

30.41 

4 

-1.46 

32 

5.26 

5 

15.79 

33 

10.53 

6 

4.10 

34 

10.53 

7 

0.00 

35 

-11.69 

8 

25.44 

36 

-0.58 

g 

35.38 

37 

10.23 

10 

9.65 

38 

21.45 

li 

-0.30 

39 

20.76 

12 

4.38 

40 

15,49 

13 

25.73 

41 

10.23 

14 

29.53 

42 

20.47 

15 

14.91 

43 

15.79 

16 

-5.56 

44 

21.05 

17 

15.79 

45 

31.58 

18 

15.49 

46 

36.84 

19 

31.58 

47 

41.81 

20 

26.32 

48 

51.75 

21 

47.07 

49 

51.46 

22 

46.78 

50 

57.01 

23 

61.99 

51 

83.91 

24 

51.17 

52 

84.21 

25 

78.36 

53 

89.18 

26 

28.07 

54 

89.47 

27 

5.56 

55 

72.52 

28 

55.85 

83 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  6o7e  (D)  PART:  I 
INDEX  OF  DISCRIMINATION 


1 

7.69 

29 

15.38 

2 

15.38 

30 

15.38 

3 

33.85 

31 

FI. 54 

4 

18.41 

32 

46.15 

5 

15.38 

33 

15.38 

6 

23.08 

34 

32.82 

7 

8.71 

35 

9.75 

8 

40.52 

36 

16.41 

9 

42. 5G 

37 

38.46 

10 

48.21 

38 

15.38 

11 

1.02 

39 

38.46 

12 

31.79 

40 

31.79 

13 

24.10 

41 

53.85 

14 

12.82 

42 

53.85 

15 

49.23 

43 

30.77 

16 

24.08 

44 

61.54 

17 

53.85 

45 

56.92 

18 

53.85 

46 

69.23 

19 

31.79 

47 

76.92 

20 

38.46 

48 

93.33 

21 

61.54 

49 

72.31 

22 

92.31 

50 

66.67 

23 

100.00 

51 

86.67 

24 

80.00 

52 

20.00 

25 

85.64 

53 

4b.  67 

26 

18.98 

54 

40.00 

27 

57.95 

55 

26.67 

28 

26.67 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  7o4e  PART:  I 
INDEX  OF  DISCRIMINATION 


1 

4.00 

29 

12.43 

2 

4.86 

30 

24.00 

3 

21.29 

31 

19,43 

4 

0.86 

32 

32.86 

5 

12.00 

33 

16.71 

6 

22.14 

34 

26.14 

7 

13.29 

35 

60.00 

8 

19.43 

36 

16.43 

9 

31.43 

?  7 

37.29 

10 

17.71 

38 

25.29 

11 

8.43 

39 

35.43 

12 

9.71 

40 

25.29 

13 

12.00 

41 

29.29 

14 

31.43 

42 

32.29 

15 

28.00 

43 

61.71 

16 

23.00 

44 

60.00 

17 

28.71 

45 

85.71 

18 

35.86 

46 

72.43 

19 

64.00 

47 

88.00 

20 

53.14 

48 

74.14 

21 

72.43 

49 

88.43 

22 

66.14 

50 

75.00 

23 

74.14 

51 

49.14 

24 

52.71 

52 

38.86 

25 

73.29 

53 

46.00 

26 

52.29 

54 

10.71 

27 

63.00 

55 

17 . 43 

28 

53.14 

85 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  7e4o  PART:  I 


INDEX  OF  DISCRIMINATION 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  7e4o(D)  PART:  I 
INDEX  OF  DISCRIMINATION 


1 

41.67 

29 

33.33 

2 

16.67 

30 

41.67 

3 

16.66 

31 

16.67 

4 

58.33 

32 

41.67 

5 

25.00 

33 

41.67 

6 

50.00 

34 

50.00 

7 

16.67 

35 

-58.33 

8 

25.00 

36 

33.34 

9 

33.33 

37 

50.00 

10 

25.00 

38 

50.00 

11 

25.00 

39 

33.33 

12 

33.33 

40 

-8.33 

13 

75.00 

41 

58.34 

14 

75.00 

42 

75.00 

15 

50.00 

43 

58.33 

16 

58.33 

44 

58.33 

17 

33.33 

45 

91.6 

18 

33.33 

46 

83.33 

19 

50.00 

47 

83.33 

20 

75.00 

48 

58.33 

21 

50.00 

49 

58.33 

22 

75.00 

50 

-8.34 

23 

75.00 

51 

16.67 

24 

0.00 

52 

0.00 

25 

58.34 

53 

-8.34 

26 

41.67 

54 

8.33 

27 

8.34 

55 

-16.67 

28 

25.00 

87 


APPENDIX  E: 

MULTIPLEX  CONTROLLER  APTITUDE  TEST 
INDEX  OF  DISCRIMINATION 
PART  n 


88 


MULTIPLEX  controller  aptitude  test 


VERSION  4e6o  PART  II 
INDEX  OF  DISCRIMINATION 


3.33 

27 

68.67 

53 

26.00 

9.33 

28 

10.00 

54 

70.67 

30.00 

29 

10.00 

55 

28.67 

20.00 

30 

11.33 

12.00 

31 

22.00 

17.33 

32 

3.33 

36.67 

33 

0.67 

22.67 

34 

16.67 

19.33 

35 

10.00 

5.33 

36 

27.33 

12.67 

37 

20.67 

19.33 

38 

3.33 

39.33 

39 

4.00 

45.33 

40 

20.00 

12.00 

41 

16.67 

-1.33 

42 

18.33 

35.33 

43 

6.67 

6.67 

44 

36.67 

26.00 

45 

30.00 

54.00 

46 

33.33 

40.00 

47 

30.00 

46.00 

48 

32.00 

50.00 

49 

53.33 

43.33 

50 

58.67 

60.00 

51 

79.33 

37.33 

52 

63.33 

89 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION:  4o6e  PART:  n 


INDEX  OF  DISCRIMINATION 


1 

4.90 

29 

5.72 

2 

5.10 

30 

9.42 

3 

10.48 

31 

1.96 

4 

4.90 

32 

13.57 

5 

4.27 

33 

9.49 

6 

16.20 

34 

7.53 

7 

15.22 

35 

25.11 

8 

24.20 

36 

16.04 

9 

12.28 

37 

34.13 

10 

20.59 

38 

13.77 

11 

27.31 

39 

6.86 

12 

9.85 

40 

18.47 

13 

-11.50 

41 

35.54 

14 

24.40 

42 

3.29 

15 

45.24 

43 

16.04 

16 

20.70 

44 

13.32 

17 

25.51 

45 

33.02 

18 

15.89 

46 

32.62 

19 

10.62 

47 

42.58 

20 

19.61 

48 

57.89 

21 

38.64 

49 

45.45 

22 

21.32 

50 

61.19 

23 

43.07 

51 

48.93 

24 

59.89 

52 

63.73 

25 

49.78 

53 

70.94 

26 

59.64 

54 

75.06 

27 

58.96 

55 

53.43 

28 

61.97 

on 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  6o7e(B)  PART:  H 
INDEX  OF  DISCRIMINATION 


1 

20.00 

30 

0.00 

2 

10.00 

31 

27.78 

3 

50.00 

32 

30.00 

4 

20.00 

33 

10.00 

5 

0.00 

34 

0.00 

6 

20.00 

35 

10.00 

7 

0.00 

36 

28.89 

8 

-1.11 

S7 

0.00 

9 

45.56 

38 

10.00 

10 

10.00 

39 

10.00 

11 

-11.11 

40 

20.00 

12 

27.78 

41 

30.00 

13 

30.00 

42 

47.78 

14 

38.89 

43 

0.00 

15 

6.67 

44 

-11.11 

16 

10.00 

45 

0.00 

17 

10.00 

46 

0.00 

18 

10.00 

47 

20.00 

19 

10.00 

48 

10.00 

20 

20.00 

49 

-3.33 

21 

30.00 

50 

17.78 

22 

20.00 

51 

11.11 

23 

40.00 

52 

40.00 

24 

50.00 

53 

40.00 

25 

20.00 

54 

80.00 

26 

13.33 

55 

80.00 

27 

-8.89 

28 

27.78 

29 

20.00 

93 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION:  6o7e(B)  PART:  H 
INDEX  OF  DISCRIMINATION 


1 

20.00 

30 

0.00 

2 

10.00 

31 

27.78 

3 

50.00 

32 

30.00 

4 

20.00 

33 

10.00 

5 

0.00 

34 

0.00 

6 

20.00 

35 

10.00 

7 

0.00 

36 

28.89 

8 

-1.11 

o7 

0.00 

9 

45.56 

38 

10.00 

10 

10.00 

39 

10.00 

11 

-11.11 

40 

20.00 

12 

27.78 

41 

30.00 

13 

30.00 

42 

47.78 

14 

38.89 

43 

0.00 

15 

6.67 

44 

-11.11 

16 

10.00 

45 

0.00 

17 

10.00 

46 

0.00 

18 

10.00 

47 

20.00 

19 

10.00 

48 

10.00 

20 

20.00 

49 

-3.33 

21 

30.00 

50 

17.78 

22 

20.00 

51 

11.11 

23 

40.00 

52 

40.00 

24 

50.00 

53 

40.00 

25 

20.00 

54 

80.00 

26 

13.33 

55 

80.00 

27 

-8.89 

28 

27.78 

29 

20.00 

93 


MULTIPLEX  CONTROLLER.  APTITUDE  TEST 
VERSION:  6o7e(C)  PART:  II 
INDEX  OF  DISCRIMINATION 


1 

0  00 

28 

28.44 

2 

0.00 

29 

11.11 

3 

21.04 

30 

11.11 

4 

28.15 

31 

51.26 

5 

3.70 

32 

25.63 

6 

-4.30 

33 

22.22 

7 

11.11 

34 

11.11 

8 

14.81 

35 

40.74 

9 

46.96 

36 

29.63 

10 

10.22 

37 

11.11 

11 

-0.59 

38 

10.22 

12 

32.15 

39 

18.22 

13 

21.93 

40 

25.63 

14 

38.96 

41 

22.22 

15 

42,37 

42 

21.33 

16 

18.52 

43 

7.41 

17 

18.22 

44 

25.63 

18 

21.93 

45 

3.70 

19 

18.52 

46 

11.11 

20 

3.70 

47 

29.33 

21 

44.15 

48 

37.04 

22 

29.63 

49 

42.67 

23 

38.44 

50 

40.74 

2-i 

55.26 

51 

25.93 

25 

25.93 

52 

18.22 

26 

38.37 

53 

33.33 

27 

-14.52 

54 

48.15 

55 

47.85 

r 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  6o7a  (D)  ,  PART  H 


1 

0.00 

28 

46.11 

2 

14.92 

29 

28.27 

3 

22.73 

30 

21.43 

4 

40.91 

31 

22.73 

5 

0.00 

32 

48.05 

6 

12.34 

33 

7.14 

7 

-11.04 

34 

26.62 

8 

28.57 

35 

-  9.74 

9 

18.84 

36 

8.44 

10 

38.96 

3" 

28.57 

11 

7.14 

38 

5.20 

12 

24.68 

39 

28.57 

13 

21.  ,3 

40 

26.62 

14 

25 .  .18 

41 

38.96 

15 

16.88 

42 

33.77 

16 

19.48 

43 

14.29 

17 

35.71 

44 

12.34 

18 

35.71 

45 

37.02 

19 

7.14 

46 

35.71 

20 

0.00 

47 

42.86 

21 

19.48 

48 

40.91 

22 

19.48 

49 

42.21 

23 

36.96 

50 

53.25 

24 

29.87 

51 

78.57 

25 

55.20 

52 

31.16 

26 

24.02 

53 

62.34 

27 

27.93 

54 

85.71 

55 

69.48 

95 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 
18 

17 

18 

19 

20 
21 
22 

23 

24 

25 
28 

27 

28 
29 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION:  7o4e  PART:  D 


INDEX  OF  DISCRIMINATION 


3.73 

30 

15.26 

-0.11 

31 

16.68 

12.39 

32 

11.83 

5.74 

33 

21.44 

5.22 

34 

25.88 

19.33 

35 

14.93 

15.95 

38 

18.53 

32.59 

37 

17.68 

28.00 

38 

25.02 

27.83 

39 

48.60 

18.31 

40 

10.78 

22.95 

41 

34.61 

4.46 

42 

49.24 

37.35 

43 

22.61 

12.57 

44 

15.67 

27.87 

45 

24.79 

20.30 

46 

12.69 

23.39 

47 

29.10 

20.15 

48 

38.45 

30.38 

49 

42.24 

35.64 

50 

61.48 

40.11 

51 

63.87 

27.15 

52 

56.06 

58.02 

53 

51.95$ 

33.47 

54 

12.13 

48.32 

55 

51.2.', 

49.77 

55.56 

8.10 

96 


MULTIPLEX  CONTROLLER  APTITUDE  TEST 


VERSION:  7e4o  PART:  II 
INDEX  OF  DISCRIMINATION 


1 

11.54 

30 

15.38 

2 

-1.93 

31 

9 .61 

3 

17.31 

32 

3.85 

4 

9.61 

33 

15.39 

5 

19.23 

34 

19.23 

6 

11.54 

35 

28.84 

7 

25.00 

36 

13.46 

8 

19.23 

37 

21.15 

9 

17.31 

38 

26.92 

10 

1.92 

39 

7.68 

11 

13.46 

40 

0.00 

12 

25.00 

41 

30.77 

13 

23.08 

42 

26.93 

14 

21.15 

43 

7.69 

15 

19.23 

44 

44.23 

18 

28.84 

45 

38.46 

17 

7.69 

46 

23.08 

18 

7.69 

47 

30.77 

19 

23.08 

48 

48.08 

20 

15.39 

49 

44.23 

21 

28.85 

50 

65.38 

22 

40.38 

51 

65.38 

23 

17.31 

52 

61.54 

24 

15.38 

53 

61.54 

25 

26.92 

54 

42.31 

26 

19.23 

55 

44.23 

27 

23.08 

28 

-1.96 

29 

13.48 

97 
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MULTIPLEX  CONTROLLER  APTITUDE  TEST 
VERSION:  7e4o(D)  PART:  II 
INDEX  OF  DISCRIMINATION 


1 

44.44 

28 

50.56 

2 

39.44 

29 

51.11 

3 

-  5.00 

30 

56.11 

4 

1.87 

31 

50.56 

5 

50.00 

32 

50.00 

6 

12.78 

33 

72.22 

7 

40.00 

34 

72.22 

8 

61.67 

35 

39.44 

e 

66.67 

36 

77.78 

10 

66.67 

37 

61.11 

11 

45.56 

38 

52.78 

12 

51.11 

39 

44.44 

13 

50.56 

40 

-40.00 

14 

72.78 

41 

40.00 

15 

18.67 

42 

40.56 

16 

51.11 

43 

5.00 

17 

48.89 

44 

5.00 

18 

17.78 

45 

83.89 

19 

77.78 

46 

78.89 

20 

77.78 

47 

55.56 

21 

58.89 

48 

67.78 

22 

88.39 

49 

48.33 

23 

77.78 

50 

53.33 

24 

1.11 

51 

48.89 

25 

79.44 

52 

23.89 

26 

51.67 

53 

6.67 

27 

83.89 

54 

3.88 

55 

13.33 

0 
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APPENDIX  F: 


OCCUPATIONAL  KNOWLEDGE  TEST 
INDEX  OF  DISCRIMINATION 


OCCUPATIONAL  KNOWLBDGE  TEST 


VERSION:  lOtB 
INDEX  OF  DISCRIMINATION 


1 

2.86 

30 

-18.03 

59 

44.61 

88 

82.12 

2 

39.26 

31 

25.71 

60 

25.16 

89 

20.00 

3 

34.47 

32 

78.89 

81 

42.76 

90 

53.18 

4 

19.26 

33 

28.57 

62 

67.46 

91 

59.26 

5 

22.86 

34 

49.66 

63 

38.53 

92 

-2.86 

6 

5.71 

35 

39.54 

64 

42.48 

93 

33.91 

7 

51.43 

36 

72.44 

65 

-22.48 

94 

62.03 

8 

23.51 

37 

62.48 

66 

36.77 

95 

44.98 

9 

46.73 

38 

51.43 

67 

67.46 

96 

60.00 

10 

38.53 

36 

-52.33 

68 

-18.41 

97 

88.57 

11 

5. 71 

40 

27.84 

69 

37.14 

98 

3.29 

12 

50.32 

41 

15.95 

70 

43.87 

99 

52.81 

13 

11.43 

42 

2.40 

71 

41.66 

100 

-2.48 

14 

56.68 

43 

65.34 

72 

38.53 

15 

53.91 

44 

85.34 

73 

28.63 

16 

22.86 

45 

46.38 

74 

43.51 

17 

42.48 

46 

49.13 

75 

-11.43 

18 

30.32 

47 

70.69 

76 

35.20 

19 

57.14 

48 

40.00 

77 

53.83 

20 

71.08 

49 

25.71 

78 

50.69 

21 

34.29 

50 

13.91 

79 

-22.12 

22 

53.55 

51 

38.77 

80 

39.26 

23 

82.86 

52 

82.12 
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The  cost  of  training  Air  Traffic  Control  (ATC)  personnel  has  risen  rapidly. 

Attrition  of  students  prior  to  completion  of  the  training  results  in  loss  of  invested 
funds  as  well  as  a  delay  in  providing  a  fully  qualified  ATC  specialist  to  the  field 
for  both  military  and  civilian  agencies.  Improved  selection  and  prediction  tests 
for  ATC  personnel  have  been  recognized  as  essential  to  decrease  attrition  rates. 

This  study  examined  ie  selection  utility  of  the  Federal  Aviation  Administration 
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prototype  ATC  test  battery .  The  test  protocol  consisted  of  the  Multiplex  Con¬ 
troller  Aptitude  Test  (MCAT)  ,  a  job  simulation  test;  and  the  Occupational  Knowledge 
Test  (OKT) ,  a  job  knowledge  specific  test.  FAA  ATC  Academy  trainees  during  the 
period  1978-1980  that  had  taken  both  the  MCAT  and  the  OKT  prototype  tests  provided 
1,954  test  subjects.  Each  subject  was  tested  using  two  versions  of  the  Multiplex 
Controller  Aptitude  Test  (MCAT1  and  MCAT2)  and  the  Occupational  Knowledge  Test 
(OKT)  providing  2,499  records  for  analysis.  Regression  analysis  Indicated  that  the 
predictive  validity  for  successful  completion  of  the  FAA  ATC  curriculum  of  the 
MCAT1 ,  MCAT 2 ,  and  OKT,  was  significant  at  the  £  <  .001;  however,  the  R2  was 
low  (R2  =  0.122) .  Consideration  of  causes  for  the  low  R2  includes  nonuniform 
distribution  of  subjects  and  possible  preselection  as  the  population  sampled  had 
previously  passed  FAA/ATC  entry  criteria.  Item  analyses  indicated  the  MCAT  con¬ 
tained  very  difficult  or  very  easy  questions  in  over  50  percent.  The  OKT  had 
acceptable  levels  o'  item  difficulty  at  the  25  percent  level .  Analyses  of  variance  of 
the  versions  of  csch  selection  te3t  (MCAT1,  MCAT2  and  OKI  )  Indicated  significant 
difference  among  the  versions .  The  nonuniform -distribution  of  subjects  and  a 
learning  effect  between  the  test  versions  were  considered  as  contributing  to  these 
differences.  Subject  sampling  and  design  counterbalancing  problems  were  dis¬ 
cussed  as  possible  contributing  factors  to  the  low  overall  R2 .  Recommendations  are 
presented  for  further  revision  and  analysis  to  Improve  the  question  utility  and  to 
develop  a  sequential  test  evaluation  of  the  ATC  applicant  learning  abilities . 
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